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It is also the case that civic education takes place both outside 


and inside the school. Civic 


knowledge, attitudes, and behavior need to be discussed in the context of the country’s culture 
(and history). Sometimes it is difficult to get consensus about which of these three elements is 
most important. Partly as a result of this complexity, IEA’s civic education studies are not well 
known even among educators. Their influence is less obvious and needs to be traced using 


methods that are similar to other subject areas and also by other 
especially true for international studies where questions are des 


methods. This complexity is 
igned based on frameworks 


including abstract concepts that may have different connotations in different countries (e.g., 


political participation, community involvement, etc.). The social and 
importance than it is in other subject areas. 


political context is of greater 


As a part of the international dissemination of results from IEA civic education studies, researchers 
conduct detailed analyses relevant to the needs and interests of audiences of educators within a 
given country. They present these data analyses at professional conferences and in professional 
publications (often in education but also in fields such as policy studies or psychology). Such events 


and publications provide opportunities to go into greater depth th 
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an is feasible in international 
presentations can deal more 


adequately with outcomes such as measures of attitudes or intended civic participation (going 


beyond reports of country rankings based on students’ correct answers in a test). 


Aggregated national average scores cannot take into account what may be large gaps in attitudes 


or participation associated with students’ soci 


a 
curricula can become out of date and have been 


background. Furthermore, civic education 
characterized in the past for practices such 


as rote memorization of excerpts from national documents detached from the realities of 
social and political life. In other subject areas it is easier to draw a line between test results 
and recommended changes in curriculum. In civic education the wide range of routes toward 
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studies; it is nevertheless important to explore them. 
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ture. Those who have guided 


IEA’s civic education studies are drawn from the field of education but also from psychology, 


This situation is reflected in our invitations to two groups of authors whose work we have grouped 


nto separate sections. One group consisted of representatives from countries who participated 
in the IEA civic and citizenship education studies. Their chapters discuss the impacts of those 
studies on various aspects of policy, practice, and research in their countries. We also invited a 
group of scholars who are linked to broad research networks including some outside of the field 


the importance of regional issues in this field and the role of social 


of education. The purpose was to expand the outlook on the studies' influence by considering 


outcomes of education (not 


merely cognitive test scores) from the perspective of several disciplines. 


A Brief Review of the IEA Civic and Citizenship Education Studies 


The first IEA civic and citizenship education study, the IEA Civic 


Education Project (testing in 


1971), was part of the Six Subject Survey, in which the following sub 
comprehension, science, literature, French as a foreign language, Eng 


jects were examined: reading 
ish as a foreign language, and 


civic education. A set of questionnaires, covering factual knowledge, civic attitudes, perception 
and understanding of political process, as well as background information, was administered 


to more than 30,000 10-year-olds, 14-year-olds, and pre-universi 


ty students across countries. 


Teacher and school questionnaires were also used to collect information about the learning 


contexts. The results were published in Torney et al. (1975). The stu 
had a somewhat unclear role as an agent of political socialization, a 


dy confirmed that the school 
topic of debate at that time. 
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The results of this first IEA study showed that students were relatively poorly informed about 
many aspects of citizenship, as well as demonstrating some basic misconceptions about 
democracy, their own governments, and politics more broadly. A very powerful predictor of 
high civic knowledge and of positive civic attitudes (for example, toward ethnic group diversity) 
was a scale measuring students’ view of the climate of their classroom as encouraging them 
to express their own opinions. In this first study there was evidence that the characteristics of 
schools operated as part of an interdependent system in their influence upon the outcomes of 
civic knowledge, anti-authoritarian attitudes, and expected participation. 


Civic education as a subject for international testing then disappeared from IEA researchers’ 
agenda for more than 20 years. The impulse for a new cycle of civic education studies came from 
the changes in political and social life experienced by nations in the early 1990s, especially the 
collapse of communism in Central-Eastern Europe and the appearance of “new democracies.” 
At the same time, declines were observed in citizens’ participation in many “old democracies.” 
This called for reexamination of the role of school in preparing young people for democratic 
citizenship and renewed directions for enhancing schools’ contributions. 


The next IEA civic and citizenship education study, the Civic Education Study (CIVED), was 
conducted in two distinct phases. Phase 1 (1994-1998) with 24 countries participating focused 
on elaborating the ways in which young people are prepared for their roles as citizens in 
democracies and societies aspiring to democracy. Extensive case study materials were requested 
from countries: document analysis (textbooks, curricula), interviews and discussions with experts 
(policymakers, practitioners, representatives of social sciences), and focus groups of students 
and teachers. Twenty-four national case studies based on this material and written by national 
research coordinators appeared in an edited book covering Phase 1 (Torney-Purta et al. 1999). 


After extensive review of the case studies to identify common issues, there was discussion among 
international project leaders. It was decided to give special attention to three content domains: 
the meaning of democracy and its institutions; the meaning of national identity; and, issues 
of social cohesion and social diversity. The group to be tested and surveyed was 14-year-old 
students; it was also possible for a country to test an older group at a later time. 


The test and survey development for Phase 2 of IEA’s CIVED began in 1994. It was important to 
obtain extensive input from country representatives in order to create a broad based framework 
that would be accepted as legitimate by a range of audiences (policymakers, those who educate 
teachers, teachers themselves, and parents). It was decided that a variety of experiences in 
school, in the home, in local communities, and in the broader society should be included in the 
investigation. In addition, a new set of factors was taken under consideration: a global youth 
culture with common aspirations for freedom and a better world, and with shared consumer tastes. 


Data collected in Phase 1 of CIVED contributed to the design of instruments for Phase 2. 
The student instrument was composed of a test of students’ knowledge about fundamental 
democratic principles and processes, a survey of concepts about democracy and citizenship, 
attitudes, and a civic related activities questionnaire. The instrument was administered in 1999 
to representative samples of approximately 90,000 14-year-olds from 28 countries. To obtain 
information about the context for civic education, a student background questionnaire as well 
as questionnaires from teachers and school principals were collected. The results can be found 
in Torney-Purta et al. (2001). In 2000 a study of upper-secondary students was conducted in 16 
countries collecting data using similar instruments from over 50,000 upper-secondary student 
aged 16.6 years to 19.4 years (Amadeo et al. 2002). 


un 


The results of CIVED helped formulate generalizations about the role of schools in preparing 
young people for their roles as citizens. There is a rich array of educational experiences that 
can be considered important. In the results overall, for example, significant predictors of the 
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likelihood of voting were civic knowledge, emphasis that schools put on the importance of 
voting as a learning objective, and open climate for classroom discussion (similar to the results 
from the 1971 study). Slightly different constellations of school factors proved important for 
the outcomes of civic education in different countries. The CIVED study also confirmed that 
schooling is positioned within a set of systems, which influence the experience of students. 
The educational background of the home was important. In summary, country differences in 
student outcomes (knowledge, skills in understanding political communication, civic engagement, 
attitudes of trust and tolerance) confirmed the complexity of the phenomenon of civic education, 
its determinants, and its anchoring in the history and culture of each country. 


CIVED strengthened the empirical foundations of civic education, as well as playing an important 
role in participating countries. The study contributed to a broad debate on the education of 
future citizens. Among other insights, the value of an open classroom climate for discussion first 
noted in the 1970s civic study was confirmed in the study of 1999 (and in subsequent studies). 


An important additional contribution to the field was that a group of researchers from multiple 
disciplines gained experience in survey methods and research during the project. Starting in the 
early 2000s many of these researchers began to use the CIVED data (and later the ICCS data) 
to publish articles reporting secondary analysis; the articles that have been published in English 
currently number about one hundred. A sense of community among civic education researchers 
as well as social science researchers has been developing. 


A few years later some of the researchers from 1999 were joined by new researchers in proposing 
a new study. The IEA International Civic and Citizenship Education Study (ICCS) was initiated, 
with data collected in 2009 and 2016, and the next cycle planned for 2022. The design of the 
CCS cycles is the same as in the case of CIVED, with a student test as well as background 
and attitudes questionnaires (for the population of 14-year-olds) and with questionnaires for 
teachers and school principals. 


The context for ICCS 2009 was marked by the growing impact of globalization and external threats 
to civic societies and their freedoms, such as international terrorism. Also, the lack of interest and 
involvement of younger generations in public and political life was an issue in many countries. 
These factors were reflected in the 2009 study's conceptual framework, which was designed 
to provide information to help countries relate the education of future citizens to changes in 
the world. In addition to the core part of the test and survey, three regional modules covering 
Asia (Fraillon et al. 2012), Europe (Kerr et al. 2010), and Latin America (Schulz et al. 2011) were 
introduced to address issues of special interest. Among these were students' perceptions of 
social cohesion and citizens' movements in Europe, of solutions for political conflicts in Latin 
America, and of roles and responsibilities of public officials in Asia. A prominent aspect of the ICCS 
study was envisioning citizen participation as a pillar of democratic societies: starting from the 
school itself and extending through local communities to the broader environment. Thirty-eight 
educational systems participated in ICCS with more than 140,000 students. The internationa 
results of ICCS 2009 were reported in Schulz et al. (2010) and in Ainley et al. (2013). 


The ICCS 2009 results showed considerable variation in civic knowledge among and within 
countries including substantial differences between high and low achievers. Socioeconomic 
factors certainly play an important role. Among the underlying factors are those important in al 
testing, such as poorer ability to read the test questions among students who attend schools in 
ess privileged socioeconomic areas. Even taking these factors into account, however, there are 
also experiences of democracy at school that clearly help students to learn and become involved. 


n most countries the development of civic knowledge is a vital aim of civic and citizenship 
education. The results of the study raised concern in several participating countries about the 
number of “low achievers” in this area. Also of concern were students who are relatively skeptical 
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role in stimulating discussion about the civic preparation of young people as well as the studies’ 
influence in the areas of educational policy, practice, and research, including building a community 
of educators and researchers; (iv) summary and conclusions indicating issues of central importance 
nd/or special concerns that might be addressed by future studies (internationally, regionally, 
or in a small group of nations). 


ied) 


The central section of each chapter is built around topics such as the role of the IEA's civic and 
citizenship education studies in discourse about education as well as in more specific impact on 
curriculum (for example, in which courses or cross curricular), pedagogy, teacher preparation/ 
professional development, researchers’ interest in the topic, or perceptions of civic and citizenship 
education in the society. Materials authors used in preparation of the chapters consisted of a 
broad range of sources including relevant documents (e.g., curricular guidelines or summary 
articles/reports) and reflections by the leaders of the study and national experts on civic and 
citizenship education. Several also employed short interviews with persons involved in making 
policy (such as educational administrators), in practice (such as teachers of civic and citizenship or 
those who prepare them), in research (such as educational or social science researchers), and in 
influencing public opinion (such as journalists specialized in educational issues). The construction 
of this section differs substantially across the country chapters. It depends on the areas in which 
the influence of IEA civic and citizenship education studies could be identified and characterized 
and also on the particular perspective of the author or authors. 


Part 2: Regional Perspectives and the Discussion of Selected Issues consists of the work of scholars 
involved in the IEA CIVED and ICCS studies in several ways: as leaders of the overall study, as 
members of its advisory bodies, and/or as researchers working on secondary analysis of the 
data from these international studies. These nine chapters are linked to various aspects of civic 
and citizenship education found in the IEA studies. They were written from the perspectives of 
political science and psychology as well as educational research and are intended to broaden 
the scope of the volume. Specifically, leaders of ICCS describe the development of successive 
cycles of studies and prospects for further development of the project. Other authors discuss 
different facets of secondary analysis and their role in building a community of practice and 
a community of researchers in civic and citizenship education (including the involvement of 
early career scholars in secondary analysis). There is a consideration of regional issues, building 
networks of researchers, and a consideration of how adding the moral education dimension could 
result in an expanded definition of the area. Broader reflections on the study from a long-term 
perspective in the regions of Latin America, Europe, and Asia are included. 


Major Influences of the IEA Civic and Citizenship Studies in 
Participating Countries 

Students’ results in the 15 countries with chapters in this volume represent a wide range of 
achievement in understanding civic and citizenship issues. They also represent a variety of 
attitudes towards political and social institutions, various levels of recognition of the rights of 
immigrants, and different levels of willingness to participate actively as a citizen. They reported 
differing experiences in their schools and communities, and characteristics of students’ outcomes 
and their correlates. There were also differences in the position or status of civic and citizenship 
education within the educational system and how decisions were made about the choice of 
topics (especially the extent to which decisions were made in a central agency or closer to the 
school level with teacher involvement). 


Countries were in general agreement that monitoring at the national level serves as a reliable 
source of information for policymaking, research, and planning reforms. The hope was that 
that educators would become more aware of and consider effective modes of learning for 
citizenship. However, there was considerable variation in the extent to which researchers in 
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and age-relevant concepts of citizenship and its teaching. 
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of practitioners (teachers’ organizations, NGOs operating in the field, or teacher training 
institutions). In several countries advice on preparing textbooks and materials based on the 
studies' findings was sought from the study team. In at least one country a study leader became 
an author of textbooks related to civic education. In one region a substantial cross-national 
community of collaborating researchers (primarily early career scholars) has been created. 


Some countries have given attention to test and survey results pointing to specific facets of 
schooling that could contribute to the improvement of student achievement. Among these 
were classroom climate for open discussion, diversifying of teaching and assessment methods, 
more opportunities for cooperation between students and local municipalities in contributing to 
ocal problem solutions, and cooperation among teachers themselves (within and across subject 
areas). These sometimes resulted in explicit recommendations for improving pedagogy that took 
into account the country’s current context. In a few countries this was reflected in renaming a 
subject when a new focus was being established (sometimes in consultation with ICCS leaders). 


Participation in the CIVED/ICCS program of studies also contributed to increasing the status of 
related subjects in the eyes of the public and of educational and governmental officials. There 
was sometimes enhanced receptiveness to the needs of particular groups of students such as 
minorities, immigrants, or students from families of low socioeconomic status. Consideration 
of the results also helped lead to enhanced appreciation of the differences between urban and 
rural schools and between different school tracks in approaches to educating future citizens. 


Preparation of teachers of civic and citizenship, their education, and in-service training was 
an important area that was highlighted. Several of the chapters (from older as well as newer 
democracies) suggested that teachers lacked a sense of confidence or an understanding about 
where they might obtain support to improve their instruction. This was sometimes related to 
perceptions of the subject area’s previous lack of status. Reforms in the preparation of educators 
were proposed in a number of countries. Results of the study were presented to teachers’ groups 
at special seminars and conferences. This took place especially in countries where students’ 
achievement was not deemed satisfactory. However, even where there were no serious concerns 
about low achievement, teachers were an important audience for the results and sometimes 
identified new avenues for improving the process of civic education. 


Participation in the CIVED/ICCS studies contributed to the construction and implementation 
of in-service teacher courses (on the national and regional levels) as well as pre-service courses 
of study. The in-service courses covered a wide range of approaches and were meant to attract 
ong-serving as well as newer teachers. An aim was often to overcome teachers’ concerns about 
teaching this subject in times of rapid transition or polarization within their countries. 


CIVED/ICCS had an impact on defining issues for research study and encouraging researchers to 
renew attention to this subject area in nearly all the countries that submitted chapters. Providing 
data for re-analysis (secondary analysis) as well as the ready availability of validated instruments 
for independent use were both important. This often attracted early-career researchers to the 
field. University based centers of this nature have been established in a few countries. To give 
just one example, the chapter on the Latin American region provides a detailed description. 


In poorly performing countries there was motivation to investigate specific aspects of teaching 
and learning in order to find better approaches. In many countries, however, it was necessary to 
consider teachers’ understandable concerns about new requirements. In countries where results 
of the study were strong, they had the potential to raise public appreciation of national (or small 
scale international) research studies aimed at strengthening connections between policy and 
practice in the field. Comprehensive research reviews that synthesize CIVED and ICCS findings 
are discussed in some chapters in Part 2. Researchers were often especially concerned by gaps 
associated with students’ socioeconomic status or (in some countries) with anti-immigrant 
sentiment. It is a bit surprising that only a few countries have focused much attention on 
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Some chapters referred to teachers' feeling not only underprepared to teach in this area but 
sometimes overwhelmed. Even authors from long standing Western European democracies 
expressed some dissatisfaction with teacher preparation (and uncertainty about what direction 
to take in improving it). That said, there were a few chapters that pointed to moderate success 
using approaches in early stages of development. A few chapters recognized teachers’ lack of 
preparation and proposed some solutions tailored to their needs. 


As the world situation changes those designing the studies are setting new benchmarks for civic 
and citizenship education and suggesting ways to take action (some of them originating abroad). 
CIVED assessed support for immigrants’ rights and support for gender equality measured with 
psychometrically strong attitudinal scales. Anumber of chapters mention results from the former, 
and a few countries discuss the latter. Over the three studies and more than 15 years country 
representatives have expressed concern about students’ lack of support for immigrants’ rights. 
This has also been the topic of a number of articles of secondary data analysis and is discussed 
in the chapter on the European region and some others. Several countries explicitly mention 
the existence of smaller gender gaps in achievement in the recent studies. 


The chapters identify long-standing problems that authors believe have been given inadequate 
attention. These are often regional in scope. Some post-Communist countries and those who 
experienced dictatorships in their recent pasts are still reporting negative situations originating 
in those eras (sometimes of particular concern in certain regions of their countries). 


Influence of the IEA Civic and Citizenship Education Studies on 
Research at the International and Regional Levels 


The need for effective civic education research is widely recognized. Research projects on 
specific issues often provide further insights, examine national reforms, encourage research on 
civic and citizenship education that more closely links the national level with the international 
level, and provide frameworks and data that encourage the involvement of a new generation 
of researchers who are familiar with innovative tools of measurement and analysis. It is clear 
that the collections of data from nationally representative samples beginning in 1999 have not 
only been utilized by individuals with deep connections to the project, but this has also inspired 
a wider group of scholars in the next generation. This can be found in the chapters in Part 2, 
especially those addressing early career scholars’ experience using CIVED and ICCS data. Other 
chapters there focused on issues for in depth discussion in the future and additional research 


in particular regions. 


The clearest example of impact extending across national borders is the way in which organizations 
in Europe (including but not limited to the European Union) and in Latin America (including but not 
limited to OAS) have publicized the findings and built on the momentum of interest generated by 
the IEA civic studies. The research provides many suggestions and new perspectives that can be 
promoted as the basis for evidence-based policy. Prior to the availability of IEA civics data, these 
organizations were often limited to basing decisions about programs on small scale research from 
non-representative samples. The topic of the rights of different groups is of interest in many 
countries. Several researchers have analyzed the data about support for immigrants’ rights, but 
less attention has been paid to gender equality. 


Growing interest in secondary analysis of the CIVED/ICCS data initiated mostly by researchers 
linked to the IEA studies has resulted in the development of a “community of researchers.” Early 
career scholars joined this community by participating in conferences and publishing papers 
based on the CIVED/ICCS data in scientific or professional journals. The chapters written by early 
career scholars in this book also include references to scale development and other initiatives. By 
disseminating validated measures as well as results IEA studies have had impact on approaches 
to studying processes of developing social attitudes. 


Professional organiz 
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ations with a focus outside as well as inside education have paid renewed 


attention to this area. More than five years ago the European Consortium for Political Research, 
a professional association largely of political science researchers, organized a special interest 
group focused on citizenship and education under the leadership of one of the national leaders 
from the IEA civic education projects. A similar interest group on civic engagement has more 


recently been establi 


shed independently in the American Political Science Association. Within the 


Comparative and International Education Society two relevant special interest groups, including 
one in which IEA researchers play prominent leadership roles, have been established. Papers with 


a focus on civic edu 


cation also are presented at IEA's International Research Conference, held 


approximately every two years since 2004. The studies have also stimulated interdisciplinary 
cooperation and suggested numerous ideas for complementary studies (some using mixed 


methods). All of this 


of future cycles of the studies. 


provides material for discussion about the development and improvement 


Modules of questions addressing issues of importance in a particular region have contributed to 
the emergence of networks of researchers across several countries in those geographical areas. 


The recognition by 


regional organizations (such as the European Union, ORELAC-UNESCO,! 


or the OAS) of the value of these data and subsequent support for related programs has been 
considerable. In addition, multi-institution research projects based on ICCS data have been 
supported by national governments and/or intergovernmental organizations as well as some 
universities and private foundations. 


Conclusions 
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EAS civic and citizenship education studies have provided benefits for the participating 
educational systems in several ways. First, they have been responsible for collecting and widely 
disseminating information about the characteristics of young citizens on dimensions such as 
their knowledge about and understanding of political and social characteristics of their own 


orld around them, their opinions about various aspects of being a citizen in 
societies, and their tendencies to behave actively in this sphere or to remain 


passive and detached. This is an important result of each study cycle because it helps monitor 


the quality of civic and citizenship education in changing world and national 


ontexts. The reports of results have in most cases taken a positive approach by noting strengths 
in particular countries (and internationally) and then focusing on ways to address weaknesses. 


at the civic and political situation is constantly changing presents a challenge. 


There are advantages to collecting nationally representative data in this subject area that can 
actually assist count 


ries in their planning and practice. Analysis and discussion can encourage 
g by various audiences of what is happening in the classroom and school. 


What actually helps teachers to teach and students to learn? Are certain practices such as a 


transversal or cross 
education subject? 
consider national or 


curricular approach likely to be more successful than having a specific civic 
s helping students to learn to confront local problems first and only later to 
international ones appropriate? Or is that no longer true in this increasingly 


globalized world? W 


hat are more (and less) successful ways to introduce improvements, especially 


those that require additional preparation for educators? A relatively new and urgent issue is how 
the digital environment influences in-school teaching. Is access to these tools of communication 
exacerbating what we know to be a gap between more and less affluent young people in their 


opportunity to acquire the resources for effective civic engagement? 


The majority of the authors of country chapters mentioned organizations such as the European 
Union, UNESCO, the Council of Europe, or the OAS. Particular chapters highlighted these 


1 ORELAC-UNESCO = UNESCO Regional Office for Latin America and the Caribbean. 
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organizations’ contributions to the teaching of topics such as human rights and environmental 
sustainability. An issue for the future is to consider effective ways of further utilizing these 
groups’ resources and extensive networks to derive and then disseminate recommendations 
tailored to specific settings. 


Practitioners in schools, civic leaders, parents, and nongovernment organizations have benefited 
from the opportunity to place their own situation and problems into a wider context. Researchers 
in a range of academic disciplines are receiving substantial material for reflection, for secondary 
analysis, and to aid in the formulation of new studies in the field. IEA studies are playing a distinct 
role in helping countries to educate their future citizens. They also provide information of value to 
international and cross-national organizations and other bodies that develop policies concerned 
with political and social development. We also cannot forget associations of educators who are 
charged with carrying out these policies. 


In summary, IEA’s studies of civic and citizenship education began in the mid-1990s and 
conducted testing in 1999 at a time when civic education was in flux—prescribed by many as 
a way to involve younger generations in solving broader problems in a newly configured world, 
criticized by some as an ineffective way to build democracy. Over the ensuing 25 years the 
studies have developed models for designing research around rich conceptual frameworks and 
using strong instruments that measure not only knowledge but also attitudes and participation. 
Arguably, the studies’ greatest success has been moving countries toward evidence-based policies 
in this area and making informed civic action at the local, national, and global level appear as a 
realistic possibility for students in a world where they are caught in health crises and involved 
in conflict situations that are beyond their control. 
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Students’ and Teachers’ Results in the IEA 
International Civic and Citizenship Education 
Studies in Flanders (Belgium): Implications for 
Cross-Curricular Approaches to Civic Education 


Ellen Claes and Linde Stals 


Abstract Belgium (Flanders) participated in IEA’s International Civic and Citizenship Education 
Study (ICCS) 2009 and 2016. During that period of seven years, the Flemish educational 
approach to civic and citizenship education evolved, and research into the impact of civic and 
citizenship education at school played a role in guiding reforms. In this chapter, we give a short 
overview of the development of civic and citizenship education in Flanders. Furthermore, we 
discuss research that has monitored and guided this process. In this discussion, we mainly focus 
on students’ attitudes toward immigrants and on teachers’ beliefs about needs in civic and 
citizenship-related teaching. 


Introduction 


Encouraging citizens, particularly young people, to actively participate in the social, political, 
and civil life has been seen as one of the major means to address issues like the lack of equity, 
solidarity, and social cohesion in societies (Sandel 1996). Democratic citizenship education, 
therefore, has become an essential part of school curricula in Western European countries over 
the last decade. In Europe, citizenship education in secondary schools is organized via three 
main approaches: as a stand-alone subject, as part of another subject or learning area, or as 
a cross-curricular dimension (Ranguelov et al. 2012). In Belgium (Flanders), it falls within the 
atter approach and has officially been a cross-curricular achievement for schools since 1997. 


The cross-curricular approach in Flanders in the late 1990s and early 2000s meant that attainment 
goals regarding civic and citizenship education were formulated for secondary schools and 
teachers. The goals focused on making schools and all teachers in these schools accountable 
for the domain of civic and citizenship education. However, the goals were not formulated in a 
way that they could be measured at the individual level. School administrators and teachers only 
had to present evidence that they attempted to reach them in young people. A large number of 
goals, and the emphasis on knowledge rather than on civic skills and attitudes (combined with 
the non-obligatory process), led to results with little substance or influence. 


In 2010 the goals were revised based on a study by the team of Mark Elchardus (Elchardus et al. 
2008). Approximately 1000 teachers, 60 principals, 6000 students, and many other stakeholders 
were surveyed. The cross-curricular approach was positively evaluated. Teachers, stakeholders, 
and principals alike thought that cross-curricular work would become even more relevant in 
the future. Specifically, civic and citizenship education was considered necessary, together with 
learning of social skills. Citizenship education was also considered more important than, for 
example, health education, education for sustainability, musical training, and education about 
technology and ICT. Regardless of this agreement on the importance of civic education, the 
report also indicated that students reported that in their perception, little time was spent on civic 
and citizenship education at school. The researchers stated the implicit character of civic and 
citizenship education could be an explanation. Although indirect forms of citizenship education 
like an open classroom and school climate are relevant, effective civic education must also have 
a base in the teaching of content. 
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CHAPTER 2: 


Bulgarian Civic and Citizenship Education in 
Transition 


Svetla Petrova 


Abstract In 2016, a new Pre-School and School Education Act was adopted in Bulgaria. This 
led to considerable change in the school system and in the concept of secondary education. 
The goal is a complete reform of the school system, school life, teaching content (in all school 
subjects), and teachers’ training. This involves a new educational paradigm and has a profound 
impact on all aspects of education—promoting the intellectual, emotional, social, moral, and 
physical development of every child. Civic competence has recently become a focus of education 
policy. The current concept of civic and citizenship education reflects experts’ agreement that 
the social mission of civic education is to harmonize the relationship between the individual 
and the state and to promote the successful integration of young people into society. Although 
significant changes in education have been made in recent years there are problematic areas 
related to the quality and efficiency of civic education in Bulgaria, which are still debated. 


Educational Context for Civic and Citizenship Education 


Educational System in Bulgaria 


The Bulgarian educational system has its foundation in the Constitution (1991), which declares 
that education is a fundamental right for all citizens regardless of gender, social background, ethnic 
origin, or religion. This fundamental democratic principle of free access to education is confirmed 
in all normative documents regulating the functioning of the educational system. Schooling is 
compulsory up to the age of 16. (In 2016, mandatory pre-school education for children at five 
years of age was introduced). School education can be acquired at state, municipal, or private 
schools. With the exception of private schools, all education is free of charge. All grade 1 to 
grade 7 students, in all schools, receive free textbooks. 


Schools in the country are primary schools (grade 1-4, ISCED! 1); basic schools (grade 1-7, 
ISCED 1/2); high schools (grade 8-12, ISCED 3); united schools (grade 1- 10, ISCED 1/2/3), 
and secondary schools (grade 1-12, ISCED 1/2/3). Primary education includes two stages: 
elementary (grade 1 to 4) and gymnasium (grade 5 to 7) schooling. During ISCED 1 and 2 
students are not divided into tracks, with the exception of relatively small numbers of students 
in some high schools, usually those with interest in mathematics and science. The first stage, 
grade 8-10, is compulsory. The second stage, grade 11-12, is elective and provides access to 
the universities. Depending on the instruction, school education is general, of special profile, 
and vocational. Students’ admission to ISCED 1 and ISCED 2 depends on parental preferences 
(with the exceptions described above). Enrolment at ISCED 3 takes place according to the 
students’ results in the external national assessment at the end of grade 7. The high schools 
can be profiled (in fields such as mathematics, science, foreign language) or vocational. There 
are also schools specialized in sports, arts, culture, and for the needs of religious denominations. 


1 ISCED = International Standard Classification of Education. 


Svetla Petrova 
email: sv_m_petrova@abv.bg 


© IEA International Association for the Evaluation of Educational Achievement 2021 13 
B. Malak-Minkiewicz and J. Torney-Purta (eds.), Influences of the IEA Civic 
and Citizenship Education Studies, https://doi.org/10.1007/978-3-030-71102-3 2 


14 


Educa 


are te 
region 
of the 


financi 


implemented according to 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


tion administration is organized at four levels: national, regional, municipal, and school. 


al level. There are 28 units, corresponding to the 


al—was considerably extended during recent years. 


schoo 


subject (Ordinance N° 5/30 November 2015). 


country. The school is a legal entity. The autonomy of the schools—both managerial and 


The Ministry of Education and Science (MES) is the central public authority responsible for 
the kindergarten, school, and university levels. The Regional Departments of Education (RDE) 
rritorial units of the MES for the management and control of the education system at 


territorial and administrative structure 


Each school’s autonomy includes school 


management and particular aspects of instructional organization. Instruction in the schools is 
the state educational standards and curriculum framework in every 


ew for the education system is the introduction of innovative schools—schools which achieve 
a higher quality of education through introducing new teaching methods or innovative elements 
in the development of teaching content, curricula, and syllabi. Recently Personality Development 


Support Centers have also been created to support the inclusion, instruction, and upbringing 
of children, as well as to cultivate their interests and capabilities. These are for students with 
special educational needs and for those with outstanding talents. 


Brief History of Civic and Citizenship Education in Bulgaria 


The modern Bulgarian state (the Third Bulgarian Kingdom) was re-established after liberation 
he Ottoman Empire in 1878. Bulgaria became a constitutional monarchy with a democratic 


fromt 


governmental sys 
Constitution was adopted in 1879. With severa 


tem, free market economy, and a multiparty political system. The Tarnovo 
amendments, the Constitution remained the 


fundamental law of Bulgaria until the end of 1947. Bourgeois-liberal in character, the constitution 
was considered advanced for its time. It granted a wide 


| Bul 


a 
a 

education is “the 
and free of charge. Nevertheless, the 
O 


reason, some historians define the poli 
et al. 1999). 


garians to obey the law, pay taxes, send their so 


nd educate their male and female children at the prima 
basis for the progress of the people” and primary education is mandatory 
ack of democratic traditions, especially in the beginning 
f the period, and the strong influence of the monarch, distorted the political system. For this 
tical system in this period as “quasi-pluralism” (Balkansky 


In that period, the fundamentals of the educational sy 


range of individual liberties; it required 
ns to the army for a two-year period, 
ry level. According to the Constitution, 


stem were established. The state and 


the central government had full responsibility for the administration and financial support of 


education. In the end of the 19th c 


ntury, six-year ma 


a 


ndatory education was introduced, as 


well as mandatory pre-school education. The teachers became civil servants and standardized 
criteria for their preparation were implemented. 


In the 


aimed 


end of 19th century, for the first time, the school subject civics was introduced. The 
subject was mandatory for students at the end of prima 


to provide every student who graduated from primary school with the knowledge and 


ry education (grade 7). Thus, the State 


skills necessary to act as a competent citizen of the country. The main content areas of civic 
education during that period were democracy and what it 
the constitution; citizens’ rights, freedoms, and responsi 


individual, society, and state institutions. In 1894, the first textbook in civics was published. 


The e 


stablishment of the totalitarian communist regi 


orientation of the Bulgarian state and the educational 


taught according to the principles of communist ideology. Anew school subject was introduced, 


means to be governed by a parliament; 
bilities; and, relationships between the 


me after 1944 changed the political 
paradigm. Civic-related subjects were 


scientific communism, which represented the main ideas in Marxist doctrine and Leninism 
(Zahariev et al. 2001). 


BULGARIAN CIVIC AND CITIZENSHIP EDUCATION IN TRANSITION 


In 1989, the Communist party resigned and the country started a process of political and 
socioeconomic reforms with a fundamental aim—restoration of the democracy. Major 
lishment of democratic institutions and 
De-ideologization was announced as one 


transformations were I 
structural reform in eco 


crisis, unemployment, i 


mplemented, such as re-estab 
nomy, culture, and education. 
of the major goals in education. However, this has not 


The Nationa 


ncreased crime rates, and corr 


| Education Act, 


adopted in 1991, regu 


bee 


uptio 


ated 


n an easy transition since economic 
n have accompanied the changes. 


the process of de-idelogization in 


Bulgarian education during that period including civic a 


the national educational standards for school conten 


nd citizenship education. In 2000, 


t were implemented. According to these 


standards, civic and citizenship education was considered a part of the cultural and educational 


field “social scien 


geography, a 


ce and citizenship education; and was taught through subjects like history, 


nd philosophy. In grade 11, a separate integrated subject, called the world and the 
individual, was introduced. 


Recent Changes in the Educational System that have Influenced Civic and Citizenship Edu- 
cation in Bulgaria 


Today civic and citizenship education has become a focus in education. It is a part of the reform 
effort in school education accomplished through the Pre-School and School Education Act in 
2016. The Act outlines the major changes in the philosophy and goals of education in Bulgaria 


and defines sc 
competences t 


to civic and citizenship education: 


e Acquiring 


e Acquiring 
e Acquiring 
human rig 


e Developme 


hts and f 


the competences necessary for successfu 
and active civic participation in modern communities; 
the competences for sustainable developm 
the competences for understanding and imple 


itizen; 


abilities; 
e Acquiring 
e Acquiring 
responsibi 


The Pre-School and School 
of the main groups of com 
In general, the aim is to en 
social processes. 


The concept 


the competen 


ities, and righ 


of civic and ci 


the competen 


reedoms, and active and responsible citizenship participation; 
nt of tolerance and respect for 
gious identity of every c 
e Development of tolerance and respect for ri 


the ethnic, nati 


persona 


ent; 


hool education as competence-oriented. Civic competences are one of the key 
hat pupils should develop in the process of general education. The law defines 12 
main objectives of pre-school and school education, at 


east seven of which are directly linked 


and professional realization 


mentation of democratic principles, 


onal, cultural, linguistic, and reli- 


ghts of the child, students, and people with dis- 


ces for understanding global processes and their interrelations; and 


ces for understanding and implementation of the principles, rules, 
ts resulting from participation in the European Union. 


Education Act outlines the social and citizenship competences as one 
petences which students have to develop during general education. 


hance the activity and involvement of young people in political and 


tizenship education is also presented in the National Child Strategy 


(2008-2018) and is discussed in the context of the challenges and risks for child development. 
ective of the Strategy is to promote children’s participation in the 


The fourth operational obj 
development and implementa 


tion of policies related to their rights and responsibilities. Acquiring 


clear understanding of the development of tolerance, adaptivity, and emotional intelligence is 


important. 


15 


16 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


Studies of Civic and Citizenship Education in Bulgaria and their Main 


Findings 


International Studies on Civic and Citizenship Education in which Bulgaria Participates 


Bulgaria co 
Association 
and TIMSS 
including P 
about the q 
citizenship 


Bulgarian st 
radical political and social changes that took place in the 1980s and 


ntinues to participate in the international assessment su 


uality of education in several key areas: reading, mathemat 
education. 
udents participated in the three civic education studies that IEA organized after th 


took part i 
the new civ 


the time an 


over a relatively long period. 


n IEA’s CIVED in 1999 together with about 90,000 1 


countries. After almost 10 years, Bulgarian grade 8 students and their teachers participated i 
ic education study ICCS 2009, and later in ICCS 2016. This allowed, on the one hand, 
measuring of the knowledge, skills, and attitudes of students in civic and citizenship education at 


1990s. Bulgarian studen 


rveys of the International 


for the Evaluation of Educational Achievement (IEA), including CIVED, ICCS, PIRLS, 
2 and the Organisation for Economic Co-operation and Development (OECD), 
SA and TALIS.? The national findings of these projects provide detailed information 


tics, science, and civic and 


e 
ts 
|-vear-old students in 28 
n 


d, on the other, identifying changes that have occurred in the preparation of pupils 


n the 


n 1999, with a mean knowledge score of 98 points, Bulgarian grade 8 students were i 


group of countries with a mean result that did not differ significantly from the average sco 
CIVED of 100 points (Torney-Purta et al. 1999). In 2009, the mean result of Bulgarian students 


was 466 points, which was significantly lower than the ICCS 2009 international mean of 


points (Sch 


re for 


500 


ulz et al. 2010; Petrova 2010, pp. 229-241). Bulgaria wa 


that achieved a lower average score in 2009 in comparison with 19 


the largest 


example, in 
deed, ina 


- 
on their ac 
cultural sta 


tatus of th 


suggested 
of the exte 
a 
Cc 


itizenship 


s among the 11 countries 
99, and the decrease was 


in Bulgaria. Subsequently in ICCS 2016 the result of Bulgarian pupils increased 


compared to the survey in 2009. Nevertheless, the mean result for 
points was again lower than the survey average of 517 points (Schulz et al. 2018; Petrova 2018). 
The findings in 2009 and 2016 showed that girls in Bulgaria had a h 


Bulgarian students of 485 


igher score than boys. For 


2009, their score was higher by 26 points, and in 2016 the difference was 37 points. 


alta and Bulgaria. 


hievements in civic and citizenship education. The stude 


eir parents was the largest in Bulgaria compared to the ot 


that the inequality in results on the civic education test in 


nd family status of the students is a strong predictor of the students 


nt of economic and social inequality in the country. To put 


n Imost all countries, the girls outperformed boys. The largest gender differences were 
identifed in 


he findings showed that the social and cultural background of students has a strong impact 


nts with higher social and 


tus had higher mean scores than the students with lower social status. The difference 
between the results of students in the two extreme categories according to the educational 


her countries in the study. 


S 
The findings and interpretations based on various studies, including PISA (OECD 2016), have 


Bulgaria are likely a result 
t another way, the social 
‘achievements in civic and 


education. The family’s influence is also visible in other results. The students whose 


parents are more interested in political and social issues are more 
with civic activities in the future. 


ikely to expect to engage 


2 CIVED = Civic Education Study; ICCS = International Civic and Citizenship Education Study; PIRLS = Progress in 
International Reading Literacy Study; TIMSS = Trends in International Mathematics and Science Study. 
3 PISA = Programme for International Student Assessment; TALIS = Teaching and Learning International Survey. 


BULGARIAN CIVIC AND CITIZENSHIP EDUCATION IN TRANSITION 


The results from ICCS 2016 showed that the civi 


c knowledge and skills of students varies 


considerably within as well as between countries. The biggest difference between the highest and 


percent of students wi 
in 
percentage of those w 
many low achievers. Th 


ternationally. Although most o 


ower achievers and en 


T 


he results of ICCS 2016 confirm 


eir effective inclu 


ed ICCS 


ng th 


but 
participating countries. 


Compared to other part 


addit 
in other countri 


between high test scores a 
example, top performing s 
they do not plan to en 


vation of th 
Bulgaria are 


nd the moti 
tudents in 


ts that efforts should be focused o 


2009 conclusion 


garia 
he su 


sion in the learni 


e students to partic 


more likely to vote 


ore 


to partici 


However, almos 


t half of studen 


ticipants in 
social campaigns and express their 
tion, significantly m 
es. Bulg 
in illegal protest activities—54 poi 
pate in illegal protest acti 


gage in active politica 


studen 


ts 


= 


For example, th 
origin. This attit 
among girls. On 
differenc 


y agree that peop 


equal rights of e 
survey—49 poin 


re 


St 
te 
a 
li 
n 


S 


school 
of studen 
number o 
is relative 


in 


y small. 


The da 
than at 


SC 


increased. 
initiatives 


part 


moderate levels of support 
atively closed (rather than open) classroom climates for disc 


udents report gaining th 
evision and their parents. 
n environment for civic acti 
mited. The comparison of st 
dicates very weak associati 
by parental education is not 


tudents in the schools where con 
students are involved in the developme 
ife, are more motivated to 
ts’ activities in the schoo 
f Bulgarian students who 


ta showed that Bulgarian pupi 
hool. Compared to 2009, more students in 
on political and social issues; their confidence in parti 


ns of pupils in Bu 
he index score of 


for women’s rights co 


They usually do not 
es and the excha 


. The dit 
stat 


diti 


par 
s are sports 
participate in 


Positive change was also observed in pupils' a 
in the future. The share of students participat 
in ICCS 2016 compared to ICCS 2009. The ICCS 2016 data showed that the students who 
ticipate in various civic initiatives at schools have 


the survey, Bulgarian students are n 
position and opinion on significant pub 
ts tend to be involved in legal and il 
aria has a relatively high average scale score for an 
nts (50 points on average for ICCS). S 
vities tended to have lower levels of ci 


in Bulgaria do express strong support 
e should have equal rights regardless of 
ude is much more pronounced among students with h 
the other hand, compared to other countries in ICCS 201 
es between perceptio 
thnic groups. T 
ts (53 points on average for ICCS). Bulgarian students across the studies have 
mpared to other countri 


eir information about political and public 


s are more active 


life as adults. This 


egal 


s showing somewhat inconsi 
ipate in civic activities. For 
in elections in the future, 
is also true in m 


owest results of the students in ICCS 2016 (the amount of variance) was measured in Bulgaria. 
For example, the difference between the five percen 
th the highest scores was 349 po 
fthe students in Bul 
ho achieved high results in t 
IS sugges 
suri 


t of students with the lowest scores and five 
ints. It was 275 points for ICCS 2016 
possess basic knowledge in civics, the 
rvey was very small while there were 
n motivation and s 
ng process. 


upport for 


stent links 


any other 


nore likely to participate in 
ic or political issues. In 


forms of protest than 


ticipated participation 
tudents who expected 
vic knowledge. 


for democratic beliefs. 


the 


garia and their peers a 
Bulgarian students is on 


ussion. 


DOU 


read newspa 


ons encourage civic activities among studen 
nt of school po 
ticipate in civic 


icy, and where 
initiatives out O 
ultural even 
ties related 


and c 
activi 


LO:S 


y involved in civic i 
2016 report b 


cipat 


media engagement o 


the students partici 
f school. The n 
ts. On the other hand, 
tudent self-governn 


nitiatives outside sc 
eing involved in discussions 
ng in various civic initiatives has also 
ttitudes towards participation in civic 
ting in volunteer activities rose substantially 


ir gender or ethnic 


igher test scores and 


6 there are significant 
t the equality and 
e of the lowest in the 


es in ICCS and report 


issues primarily from 
pers. The use of socia 
nge of information on civic issues is still very 
nts’ engagement with social media and their socio-cult 
fference between socia 
tistically significant. 


media as 


ural status 
f students 


ts, where 
pate 
reas 
the 
nent 


nain a 


hool 


more positive attitudes and are more likely 


18 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


to participate in civic activities in the future. That means that the school has a potential not only 
to teach civic knowledge and develop skills but also to create positive attitude toward active 
civic behavior among young people. 
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Youth who participate in elections are more likely to live in rural areas and trust local authorities 
more than the central government. They trust local politicians and parties more. 


The survey results suggest a lack of representation of youth in politics, which is seen as a remote 
domain, reserved mainly for politicians. 
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for considering educational policies and even some innovations aimed to impose a culture of 
creativity, flexible learning models, and use of a variety of educational resources (Petrova 2010; 


2012; 2018). 
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CHAPTER 3: 


The Influence of International Civic and 
Citizenship Studies on Education in Chile 


Gabriela Cares Osorio and Elisa Salinas Valdivieso? 2 


Abstract This chapter addresses the participation of Chile in IEA’s Civic Education Study (CIVED), 
nternational Civic and Citizenship Education Study (ICCS) 2009, and ICCS 2016. Participation 
in these civic studies has influenced civic education in the country in different ways. First, it 
contributed to educational discourse by providing relevant evidence on students’ knowledge and 
attitudes. Second, it served as an input that triggered curricular revisions and modifications in 
the last 20 years. Third, it shaped a research community in the field. Key to these contributions 
have been both the results of the studies and their assessment frameworks. These elements set 
a common language in educational discourse and provided evidence that serves as a foundation 
for further discussions. 


Introduction 


Chile has a long tradition assessing students’ achievements. In the last two decades, together 
with well-established national programs of evaluation, the country participated in several 
international assessments of student achievement including the International Association for the 
Evaluation of Educational Achievement's (IEA) TIMSS, CIVED, and ICCS,° and the Organisation for 
Economic Co-operation and Development's (OECD) PISA.* The decision to join an international 
study is centrally taken by the National Council of Education, based on a proposal presented 
by the Ministry of Education. Once approved, the participation of the country in each project 
is included in a medium-term strategy, providing stability despite possible changes of priorities 
across the years. 


The implementation, analysis, and release of results from national and international assessments 
has been the responsibility of the Educational Quality Agency since 2012. This institution is 
mandated to conduct assessments and inform the school system and the general public about 
educational quality. Since its creation, the Agency has communicated information intended to 
appeal to and mobilize groups with diverse interests. Providing evidence for policymaking is a 
strategic goal and spreading the results of international assessments in the media is a regular 
practice. The information is targeted at school communities, policymakers, and academics. 


Chile joined the three cycles of the IEA studies in civic and citizenship education—CIVED 1999, 
ICCS 2009, and ICCS 2016. Currently, it is preparing its participation in ICCS 2022. In this 
chapter, we review how regular participation of Chile in the IEA civic studies has contributed to 
the academic and public debate in the country regarding civic and citizenship education (CCE), 
and consequently, educational policies related to CCE in schools. In order to do so, we first 
describe how CCE is implemented in the Chilean school system, and comment on the key social 


1 Elisa Salinas is part of the European Training Network OCCAM. This project has received funding from the European 
Union's Horizon 2020 research and innovation program under the Marie Sktodowska-Curie grant no. 765400 

2 Both authors were responsible for the implementation of ICCS 2016 in Chile at the International Assessment Unit in 
he Educational Quality Agency. 

3 TIMSS = Trends in International Mathematics and Science Study; CIVED = Civic Education Study; ICCS = Interna- 
tional Civic and Citizenship Education Study. 

4 PISA = Programme for International Student Assessment. 
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CHAPTER 4: 


Civic and Citizenship Education in Colombia: 
Challenges for Students and Teachers 


Luis Felipe Dussán Zuluaga and Juan Camilo Ramirez Chaguendo 


Abstract Civic and citizenship education in Colombia has changed over the last two decades. The 
socioeconomic context and internal armed conflict, among other issues, have influenced the way 
that students have been taught. Several studies have been carried out to assess teaching about 
these topics in the country. This chapter briefly discusses the contribution IEA's International 
Civic and Citizenship Education Study (ICCS) has made to civic and citizenship education in 
Colombia and discusses the possible causes of the performance of the country in this study, 
as well as possible steps for its improvement. It also discusses how teachers’ training, schools’ 
autonomy, and limited resources for pedagogical improvement could be related to these results. 


Introduction 


Research on civic and citizenship education is crucial for understanding the contexts in which this 
topic is taught, and the competences students are developing. This chapter considers aspects 
that could affect the citizenship attitudes of young students, as well as the social and political 
behaviour of current and future generations. It, therefore, represents an opportunity to gather 
relevant data for the design of education policies to help achieve specific educational goals. 
Similarly, studies of civic and citizenship education provide information on how this subject 
is taught within schools. This is a key source to ascertain how political efforts (e.g., relevant 
educational reforms, laws, projects) are being implemented inside schools (Valencia 2019). 


Colombia, as defined by its Constitution (1991, Article 1), is a democratic, participatory and 
pluralistic country, based on human dignity, joint interest, solidarity, and work. From this 
statement, it can be inferred that citizens should be educated through the lenses of human 
rights, peace, and democracy. In addition, Article 41 states that the study of the Constitution 
and civic instruction is mandatory in schools; thus, principles and values related to citizenship 
participation should be promoted within the school. This sets the ground rules for guidelines 
detailing what students should be taught in subjects related to civics and citizenship. 


Currently, civic and citizenship education in Colombia is based on the Standards of Citizenship 
Competences designed by the Ministry of National Education in 2003: a set of cognitive and 
non-cognitive competences needed for the conscious and responsible exercise of citizenship in 
the social and political realms. These documents are intended to serve as one of the guidelines 
for teachers to build their curriculum. 


However, it is often difficult for teachers to teach civic and citizenship education in the way that 
the constitution and the educational law requires and to promote the competences established 
in the Standards of Citizenship Competences. In addition to the lack of supportive materia 
mentioned, the political, economic, and social contexts of the country have influenced the topics 
covered in this subject (Herrera 2008a). As the Ministry of Education (2011) recognizes, “in a 
country like ours, marked by a history of inequity, violence and exclusion, the challenge is not 
simply to train people to follow rules without question, instead we needed people to commit 
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diversity), and the relationship one might have with the institutions (participation and democratic 
responsibility) (Icfes 2013). These are administered to students in grades 5 and 9. In contrast, 
the test that assesses cognitive competences is administered to students in grades 5, 9, and 11, 
as well as to students in universities. 


Concurrently with assessing civic and citizenship competences within the country, there have 
been local and institutional initiatives related to peace education, human rights, conflict resolution, 
and youth leadership, some of them established by the Ministry of Education, others by private 
institutions, and some by both. For example, private programs like Hermes Program (Programa 
Hermes), Life Skills (Habilidades para la Vida), Peace Games (Juegos de Paz), Classrooms in Peace 
(Aulas en Paz), among others (MEN 2006a), and programs from the Ministry of Education that 
blend approaches like Learning Network (Red aprender). On the other hand, in addition to these 
programs and initiatives, the Peace Seminar (Cåtedra de la Paz) was established by Law in all 
schools in 2015 (Congreso de la Republica de Colombia 2015). This program seeks to generate 
more peaceful environments by promoting emotional, cognitive, and communicative abilities or 
strategies as part of civic and citizenship education (Jaramillo and Mesa 2009). 


Furthermore, when talking about Latin-American projects, it is inportant to mention the Regional 
System of Evaluation and Development of Citizenship Competences (Sistema Regional de 
Evaluacion y Desarrollo de Competencias Ciudadanas) led by Colombia and funded by the Inter- 
American Development Bank, which aims to contribute to civic and citizenship competences 
construction in the region through the strengthening of education for the citizenship and 
democracy (Icfes 2018). 


As mentioned, the General Law of Education of 1994 allowed schools to decide the specific 
content and pedagogical practices to teach each subject (school autonomy). Therefore, schools 
and teachers play a significant role in the development of civic and citizenship competences. 
n practice, schools traditionally delegate civic and citizenship education to social sciences 
teachers, de-emphasizing the idea of citizenship education as a transversal project (Gonzålez- 
Valencia and Santisteban-Fernandez 2016). This is a critical issue because many argue that civic 
and citizenship instruction should not be limited to just one subject; on the contrary, it should 
be an overarching theme in all school subjects. At the same time schools and teachers’ beliefs 
have often shaped the way that civic and citizenship competences are taught, which represents 
another challenge for the implementation of the Standards. 


Finally, the Constitution gives autonomy to local authorities to guide and be responsible for 
education in their jurisdiction. However, some local authorities do not have the required 
resources to thoughtfully examine the teaching plans that are being followed in each school, 
and therefore they cannot give them the support they need. This limited information hinders 
the Ministry of National Education’s knowledge about how civic and citizenship competences 
are being developed within the schools. This is a major concern, because of the belief that the 
whole educational institution system should be involved (Icfes 2018). 


Colombia’s Participation in ICCS and its Influence on Icfes’ Assessments 
of Civic and Citizenship Competences 


This section presents the main results of Colombia in ICCS 2016 compared to ICCS 2009 and 
describes the contribution of the study to the creation of both the National Standardized Test of 
Citizenship Competences and the Test of Citizen Actions and Attitudes, taking into account the 
ICCS aim related to investigating how young people (14-year-olds) are prepared to undertake 
their roles in different countries (Schulz et al. 2016). It also describes the dissemination of results 
among teachers across the country. 
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Such outcomes, along with ICCS results, should serve as a motivation for principals and local 
authorities to begin a process of deliberation about pedagogy to identify strengths and challenges 
n citizenship education, which could work toward improving students’ skills (Icfes 2016a, 201 6b, 
2016c). As the Ministry of Education (2006b) recognized “it is important to contribute to the 
development of competences that can help children and young people to manage the complexity 
O 
a 


f life in society and to continue developing them—we must not forget that human beings are 
ways developing these competences” (p. 154). 


Additionally, besides Icfes assessments, other tests were conducted. In Bogotá, for seven 
years starting in 1997, the Basic Skills Assessment Project Tests (Proyecto de Evaluación de 
Competencias Básicas) were developed to assess students civic knowledge, as well as the 
degree of trust in political institutions or political actors (like the president, congressmen and 
congresswomen, the church, guerrilla groups). Moral and social development was also assessed 
(Torres and Díaz 2005; Jaramillo and Mesa 2009). Also, Los Andes University and the Secretariat 
of Education of Bogotá conducted the School Climate and Victimization Survey (Encuesta de 
Victimización y Clima Escolar) with grade 11 students and found large percentages of students 
reporting victimization by criminal acts like robbery (Chaux and Velásquez 2008). 


Similarly, to ICCS results, these reports showed the need to address the issue of education for 
coexistence as an integral part of the educational process. It was clear that teachers lacked the 
necessary conceptual and methodological tools to work with these concepts (Restrepo 2006). 


Icfes National Workshops 


Since 2015, Icfes has offered workshops that provide guidelines and instruction to principals 
and teachers of public and private schools about the interpretation of results of the national 
standardized tests. The purpose is to improve the quality of education. The information given 
in these workshops is also offered in printed and digital media, for school staff who could not 
attend the session. 


Between April and August of 2018, 126 workshops were held in 104 Colombian cities and 
approximately 10,000 principals and teachers attended, representing around 7000 schools. In 
that year, for the first time, the workshops included discussion about the results in ICCS 2016. 
The main purpose was to share with principals and teachers information about the test, the 
assessed competences, and the achievements and challenges that it implied for Colombia. It 
was important to point out how civic and citizenship education strengthens attitudes that favour 
democracy. Students with low levels of civic and citizenship knowledge are unaware of social 
and political problems in the country and tend to show favourable attitudes towards corruption 
and authoritarian governments as well as disobedience of the law (Icfes 2017). 


To understand the utility of having included information about Colombia's ICCS 2016 results in 
the 2018 workshops, Icfes conducted a web survey (in November of 2018) with the participants, 
and more than 600 participants replied. This survey inquired about current strategies that schools 
have implemented regarding civic and citizenship education, and how these were improved by 
the information they received about ICCS 2016 in 2018. Most of the participants (89%) were 
interested in getting involved in related projects, and 60% of the participants reported sharing 
the results with the other members of their schools. It is important to mention that the survey 
was designed to inquire about the way teachers who attended the workshops were using the 
information. This was only for internal purposes and was not published. For this reason results 
must be read and interpreted carefully. 


The survey also inquired about possible changes in their curriculum or classes’ content related to 
civic and citizenship education. About half of the educational community who replied reported 
they had made changes in their school curriculum or their practices on this matter. These changes 
were mainly related to the issue of peace, and some of them emphasize the implementation of the 


44 INFLUENCES OF THE IEA C 


IVIC AND CITIZENSHIP EDUCATION STUDIES 


Peace Seminar and related seminars along with other factors. Furthermore, 19% had conducted 
an additional inquiry into civic and citizenship education, mostly related to peaceful coexistence 


and community knowledge. Finally, 89% said they woul 


d consider curricular improvements and 


activities with the community. More in-depth investigations should be pursued. 


Brief Discussion of Civic and Citizenship Education in Colombia 


Colombia’s Educational System Challenges 


As indicated previously, the Colombian Standards of Citizenship Competences offer a guide 


to civic and citizenship contents. These standards atte 


mpt to counteract recourse to violence 


by developing the civic and citizenship competences of students and teachers. The intention 


was to establish public and clear criteria, which would 


allow schools to establish basics levels 


of civic and citizenship education for children and young people. The standards are focused on 
three main components: peace and co-existence; democratic participation and responsibility; 
and, finally, valuing plurality and differences in identity. Cognitive, emotional, communicative, 


and integrative competences were identified (MEN 2011). 


However, it is difficult to teach the relevant concepts in the way that the Standards of Citizenship 
Competences suggest. On the one hand, the standards state what competences are expected 


from students but do not explain how they might be 


and teachers within the classrooms (Chaux 2009). Even with the efforts made by the 


of Education programs and private and local programs 


developed by principals in the schools 
inistry 
, it is not completely clear how schools 


can develop these competences. Additionally, the role given to schools by the local authorities 
usually emphasizes administrative and financial tasks, instead of focusing on their pedagogical 


and educative responsibilities (Pinilla and Torres 2016), 


civic and citizenship competences. 


At the same time, given schools autonomy and the limi 


which limits the clear development of 


tations of local authorities, the Ministry 


of National Education has limited control over the development of students’ competences as 
the Standards of Citizenship Competences suggest. This lack of specificity and oversight by 


local authorities and government presents a challenge 


in translating the standards to practice 


and motivating local institutions to support their implementation (Berkowitz and Bustamante 
2013). Based on these observations of civic and citizenship education in the country, Noonan 
(2010) cautioned that the standards’ implementation is often neglected. 


Icfes' preliminary survey results following the 2018 wor 


shops showed that civic and citizenship 


education was mostly understood by teachers as re 
ethics, and society. Many respondents did not mention 
participation, responsibility for individual actions, and res 


ated to life plans, peace, coexistence, 
ey concepts such as democracy, citizen 
ponsibility for the environment. Similarly, 


Gonzålez-Valencia and Santisteban-Fernandez (2016 


conducted qualitative research using 


instruments like structured surveys, interviews, focus groups, and the observation of classes. 


One of their conclusions was that Colombian teachers 


'" knowledge about civic and citizenship 


is characterized by very concrete beliefs that lack depth of understanding. For example, the 
authors highlight that some teachers argued that: “a citizen is that person who has the legal age 
and an identification document,’ and that “politics and government are synonymous.’ Also, some 
answers from the Icfes workshop survey showed that civic and citizenship education could have 
a role in the resolution of conflicts and respect for racial and cultural diversity. 


Additionally, the principle of school autonomy has just 


fied a wide range of curricular content 


ti 
or pedagogical practices as part of the subjects related to civic and citizenship education. 
For example, school curriculums are mostly focused on the areas that are assessed the most 
frequently—language and mathematics (Berkowitz and Bustamente 2013)—and leave aside civic 


and citizenship concepts and practices. Some argue that these concepts could be taught as 
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recently suggested that Colombia’s education system needs to recognize that a space 
on and ways to increase motivation. This could happen through 
daily relationships inside and outside school settings (Rodriguez 
zen does not rely exclusively on knowledge of concepts; instead, 
it is widely associated with the skills that allow one to relate positively to others. This can be 


developed through practical activities and discussing reflections about students’ actions in 
specific contexts including the school Jaramillo and Cepeda 2004). 
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Concluding Thoughts 


This chapter describes the context of civic and citizenship education in Colombia, as well as 
Colombia’s participation in ICCS, its influence on the National Standardized Test of Citizenship 


Competences and the Citizen Actions and Atti 
ttended the Icfes 2018 worksh 
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nd citizenship education represents both a challenge 
tems and target civic issues in Latin America. 
dience. In this respect, the Colombian experience 
suggests how researchers and experts in civic and citizenship areas can join policymakers and 


ups to broadly influence the nature and effectiveness of educational efforts 


t but also to promote the positive development 


and citizenship competences in the Colombian population (Berkowitz and 


. 


n government policies and local needs, practices, 


and expectations (Pinilla and Torres 2006), is one of the reasons why schools have minimal time 
and resources to focus on pedagogical and educational activities. Additionally, teachers' initial 
be focused on factual contents relevant for history and geography with less 
tic training oriented to teaching civic knowledge and developing social thinking 
(González-Valencia and Santisteban-Fernandez 2016). As a result, the existence of schools' and 
teachers’ pedagogical weaknesses makes it necessary for civic and citizenship studies in the 


formation used to 
emphasis on didac 
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CHAPTER 5: 


Civic and Citizenship Education in Denmark 1999- 
2019: Discourses of Progressive and Productive 
Education 


Jens Bruun 


Abstract This chapter addresses the participation of Denmark in IEA’s Civic Education Study 
(CIVED) 1999, International Civic and Citizenship Education Study (ICCS) 2009, and ICCS 2016. 
The first sections present the Danish implementation of civic and citizenship education as a 
whole school approach and describes changes to this tradition during the period 1999-2019 
in school policy and in teacher training. Examples of how the main national results of these IEA 
studies have been perceived and used are also discussed. The final sections of the chapter address 
how different education discourses have played an important role for public school debate, for 
school policymaking, and for educational research. Finally, it is discussed how general changes 
in school policy, without officially being labelled as changes to civic and citizenship education, 
have implications for the school as a place for civic and citizenship education. 


Danish Participation in CIVED 1999, ICCS 2009, and ICCS 2016 


Since joining the International Association for the Evaluation of Educational Achievement 
(IEA) Civic Education Study (CIVED) late in 1998, Denmark has participated in the CIVED 
999 study (including testing upper secondary students in 2000) and International Civic and 
itizenship Education Study (ICCS) 2009 and ICCS 2016. The current author (The Danish School 
f Education, Aarhus University) was a major researcher in both CIVED studies and national 
research coordinator (NRC) in both ICCS studies. 


1 
Ç 
O 


Description of Civic and Citizenship Education in Lower Secondary 
School 


By tradition (and law), civic and citizenship education (CCE) in Denmark is based on a whole 
school approach, i.e., a combination of curricular, cross-curricular, and non-curricular components. 
n ICCS 2016, 93% of the Danish students attended a school whose principal reported that 
CCE is a matter for teachers teaching within the humanities/social science-related subjects. For 
81% of the students CCE is a whole school approach, for 70% CCE is a separate subject, and 
for 68% CCE is a part of all subjects (Schulz et al. 2018a). 


However, the way school principals implement CCE depends on how they value its different 
components. A Danish tradition for progressive education (especially from about 1975 to 
1999) linked CCE to the German tradition of “Bildung” (education as a personal and cultural 
maturation in the process of human development). This dimension of school is often captured 
in the concept “democratic Bildung” (“demokratisk dannelse” in Danish) as the essence of the 
CCE whole school approach. It is a common perception that this ethos still plays a major role 
in Danish schools. However, in official curricula guidelines, CCE-related aspects tend to be 
introduced in a more academic sense (if mentioned at all). It is evident from ICCS 2016 that 
the majority of students attend a school where the principal tends to view knowledge as more 
important for CCE than the promotion of engagement, participation, and values (Schulz et al. 
2018a, p. 34). This is probably to avoid the normative and moral dimensions of CCE (and the 
specter of political indoctrination). 
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On the national level, the “Folkeskole” is the Danish name for the pu 


blic municipal primary and 


lower secondary school; all these schools share standard requirements concerning the subjects 
to be taught! and the leadership and organization of the schools. The Education Act for the 


Folkeskole states that the school “must prepare the pupils for partici 


pation, joint responsibility, 


rights and duties in a society with freedom and democracy. Therefore, the functioning of the 
school must be marked by freedom of spirit, equal worth and democracy” (Retsinformation 


2017, 81,3). 


The law does not provide details about implementation, and CCE is not an explicit content domai 
in the curriculum guidelines in lower secondary school. To some degree, this is appropriate for th 


whole school approach since CCE is very much an implicit dimension across different subject 


and the school in general. 


In grades 8 and 9, students attend “Samfundsfag” (i.e., “society subject” 


sociology, political science, and economics. The Ministry of Education recommends that student 


O I 


[Va] 


) or social science includin 


This subject used to be “Samtidsorientering” (“contemporary society”), introduced in the Publi 
School Act in 1975 (Struwe 1977). In 1993, samtidsorientering became social science for grad 
9 and was made mandatory for grades 8 and 9 in 2005 (Ministry of Education 2006). Social 
science covers many aspects outlined in the ICCS framework (Schulz et al. 2016), especially 
within the content domain about society and political systems. The purpose of social science is 
to develop students’ competences to take an active part in democratic society and to promote 
critical thinking and core personal values. These content domains are mandatory (EMU 2017): 


Union and Denmark, international politics 


sustainability 
3) Social life and culture: socialization, culture, social differentiatio 


Methods: communication, information gathering, statistics 


8 
S 
in these grades receive two social science lessons (of 45 minutes) per week per school year. 
c 
e 


1) Politics: democracy, the political system, parties, ideologies, media and politics, the European 


2) Economy: private finance, consumer behavior, welfare states, the market economy, 


n (equality and inequality) 


The subject is intended as an introduction to social science as a set of scholarly disciplines with 


ied) 


three dimensions: political, social, 


nd cultural. There are no requirements prioritizing local, 
national, regional, or global dimensions. In 2006, the Ministry of Education decided that social 


science should not include the relationship between man and nature and that sustainability in 
social science should be introduced in the context of the topic of economic growth. This was a 


part of revisions where the Ministry gave the subject a more acade 
profile (Kaare 2006). 


Social science is one of six humanities/social science subjects that do 
nstead, each school year after grade 9, one of these subjects is drawn 


an article) about a self-chosen problem to be examined in an ora 


inistry of Education 2018b). 


mic rather than normative 


not have compulsory tests. 
by lottery for examination. 


f social science is drawn, students must prepare a product (for example, a movie, a poster, or 


examination (Ministry of 


Education 2018a). The most recent guidelines highlight two ways of teaching social science: 
the open school method and problem-oriented project work. These methods entail visits to 
and cooperation with relevant institutions and/or students investigating topics outside school 


The Ministry of Education guidelines for other subjects include very little explicit CCE-related 
information. The guidelines for the subject of Danish include some content objectives potentially 


1 In Denmark some schools are so-called "private schools” or “free schools.” They must measure up to the same 


standards as public schools. 
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E. Two examples from the history 
constitution of 1849 and women’s right to vote (1915). 


ey are not officially defined as par 


mentary tasks. Some of these can be 
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but with no mandatory number of lessons 


mily knowledge; education and occupati 
sting mandatory subjects from grade 1 


on. 
to 


included in mini 


2018c, 2018d). 


7, and 2019 the Danish Ministry of 
entary elections for grades 8 to 10 in c 


hive of 


is is not mandatory, but man 
nes, and recommendations from 1995-201 


sterial guidelines for the subjects (Min 


Education and the National Parliament 
Danish Youth Council 


th The 
y schools par 


ooperation wi 


ticipated. 
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students have had the right to form 
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ol projects (Min 
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ong tradition in 


levels (Christensen and Olsen 2013 
Councils have very limited real infl 


authorities ar 
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uence, yet this 


) 
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influence (Retsinformation 2014). 


Education 2008). 


ide how student counci 


ects they should be included. In additi 
cross-subject themes”: innovation and entrepreneurs 
ia; development of language skills. These must be integrated into and across the 
ndatory subjects and are 


on, 
hip; 


istry 


held 


The 
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emocracy (in English) containing exam 


udent councils in Folkeskole 
ncil at a 
perception (and often a fact 
varies c 


Civic and Citizenship Education in Danish Teacher Education 
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t of their t 
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r 2017/2018 almos 


t 82% of the teachers teac 


eacher training (Styrelsen 


E trai 


is a compulso 
and citizenshi 
democracy a 
with general 


to ethics and 
other words, 


nd citizens 
professiona 
this subject, which has eight kn 


Ethical questions are posed wit 
political perspectives on the ot 


requirements with regard to CC 
ry subject in the teacher-trainin 
p, which provides insight into religion 
hip. This subject is part of 
competences. It is manda 
owledge goals. Three 
three to human righ 
politics o 
hin a com 


8 pro 


philosophy, and 
he foundation of 


text 


gram called “Chri 
and 
basic subj 
tory 


ts, C 
r democracy as a secular mati 


culture, the 
ects in 
for all teacher-training programs 
these relate to Christianity/religion, 
itizenship, and democratic principle 
ter is not particularly 


history of ethics, alo 


of 


with reli ide 


plex con 
ocracy Is 
of Christi 


her. Dem 


including the 


(alleged) co-development 


appears to be 


implemented in somewhat differen 


gious perspectives on one s 


ples 


. Since 1986, 
ny school with five or more grade 
that Student 
onsiderably, because local school 
s function and the extent of their 


E at school is mainly perceived as a whole school approach involving all teachers and all 
jects. However, some teachers of social science may be seen as specialists: In the school 
hing social science studied social science as 
for IT og Læring 2018). 


ning for teachers in general. However, there 
stianity, life-enlightenment 
ng with 
tended to provide teachers 
to offer 


two 
s. In 


strong. 


and 


dealt with as a part of a broad cultural heritage, 
anity and democracy in 
t ways in different teacher-training institutions. 


Denmark. The subject 
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Changes to Democratic Aspects of the Folkeskole and Teacher 
Education (1999-2019) 


Apart from the development of social science as a sch 
have been no major curriculum changes for CCE in Danish lower secondary schools. However, 
some changes that affect the CCE whole school approach are worth considering even though 


equal worth an 


Another remar 
with the 1990 aboli 
leadership with 
making authori 
Also, in 1990 t 


for the Folkeskole Act, 
that the abolition of the Teachers’ Council was an attempt to wea 
management (Madsen 2015). 
was made voluntary with a similar intent (Christensen and Olsen 2 


the Danish CC 
school must be “marked by” freedom of spirit, equal 
changed from 


n 2007 a law discontinued a mandatory subject in 
society.” The purpose of the subject was to enhan 
the societal role of the school in a democracy from historical and contemporary perspectives 


nthe Folkeskole reform 


I 


2011; 


somewhat less importan 


able change is a weakening of the democrati 
tion of the Teachers’ Council (consisti 
a teacher chairman). It was replaced by a Pedagogical Council with less decision- 
ty (Christensen and Olsen 2013a; Vestergaard 1996; Skovgaard-Petersen 2018). 
he School Committee (skolenævn) was abolished and replaced by a School Board 
(skolebestyrelse) strengthening the influence of the school principal and parents (Recommendations 
columns 5174 and 5175, in Lovforslag nr. L215, 1989). It is widely believed 
en teacher influence on school 


c influence of teachers. This began 
ng of all teachers and the school 


ool subject, between 1999 and 2019, there 


they have remained largely unnoticed. In hindsight they seem to form a consistent policy that 
decreases the attention paid to the democratic influence of teachers and students. Claims about 
E whole school approach often refer to the Education Act, which states that the 
worth, and democracy. This statement has 
previous versions of the Act (1975 and 1993), which in stronger terms claimed 
that the “teaching and entire daily life of the school must be founded on the freedom of spirit, 


d democracy” (emphasis added; Thejsen 2009). 


2013, the mandatory Pedagogical Council 


013b). 


teacher education called “the school in 
ce incoming teachers’ understanding of 


Simonsen 2004). According to Hedegaard et al. (201 


11), the subject was popular and received 


ighly positive assessments from external examiners. At presen 
teacher education that introduces the basic political/democratic dimension of the 
institution in society. 


n 2007, the solution was to replace “the school in society” with 
dimension of the then existing subject “Christianity and life-enlig 
EVA 2003). However, in 2012/2013 “Christiani 
in danger of being discontinued. For many educators 
progressive education and “Bildung.” So, the ministry’s 
scholars and both left and right political parties). It 
t role (Rømer 2018; Lund 2012; Kemp 2013). The s 


controversial because, in the view of its proponents, 
traditions. However, in the view of critics, this is irre 
asis on global dimensions of citizenship these national and cultural 
n teacher education have diminished relevance. 


and an increasing emph 


dimensions i 


it represents | 


“citizens 


t there is no specific subject in 


school as an 


hip” as a new third 


htenment” 


Hedegaard et al. 


ty, life-enlightenment and citizenship” was 
the crux of this subject is the tradition of 


move stirred 
survived in 


protests 
teacher 


evant. In an era with 


mportant 


by hig 


hly esteemed 


education but in a 


ubject 


m 


is somewhat 


Danish values and 
ulticultural trends 


A Danish tradition, which for many years was considered of vital importance for the Folkeskole, 


is the so-cal 
has the resp 
pedagogical 


ed "class teacher." The concept refers to the practice that one teacher of a class 
onsibility for the social life and wellbeing of students, for coordinating activities, 
issues, and teaching plans with other teachers, for planning meetings with parents, 


and for coordination with the school principal regarding matters related to the class. This class 


teacher wou 


d know all the individual students and their parents (and vice versa) from their very 


first day at school and be able to closely follow the development of each student throughout all 
years of schooling. This tradition was changed and partly abolished as part of a major Folkeskole 
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reform in 2013. In this reform, the class teacher is no longer necessarily a specific pivotal person 
with assigned responsibilities. On the contrary, the tasks and responsibilities of the class teacher 
are re-defined as so-called “functions” that the school principal may assign in different ways and 


class teache 


in different school years to various teachers and/or other pedagogical staff. 


nterestingly, the role of the 
Education (supported by eight educational experts), because the role of the class teacher had 
been strengthened by law in 
still pivotal as the person creating the best possible conditions for the individual 


ris 


class teacher was the sole topic of a 1996 book by the Ministry of 


1993. The very first sentence states: “In the Danish Folkeskole, the 


class and the individual student, both in academic and social matters” (Ministry of Education 
1996, p.7). It is remarkable that this key role has been discontinued after numerous decades 
a hallmark of Danish schooling practices (Bramming et al. 2009; Christiansen 2009). 


when it was 


Skole og foree 


Furthermore, for many years, the class teacher’s tasks were linked to the so-called “class hour” 
dre n.d.), which secured specific extra time for social activities and discussions 
intended to promote social cohesion among classmates. The class hour was established in 
1975. It was considered unique for the Folkeskole as a way of promoting democratic processes 


in class. For example, the class representative in the Student Council would have ample time to 
discuss issues and proposals without disturbing lessons. This could provide an opportunity to 
introduce praxis in deliberative democracy and strengthen student participation. This activity 


was also abolished as part of the Folkeskole reform 2013 (Christiansen 2017; Kristensen 2010). 


Changing the role of the class teacher and abolishing the class hour are significant because both 


Abolishing t 


In a famous 


discussions 
Since then, 
progressive 


This politica 


education policy tren 
outcomes. In this pers 
class "leadership" 


professional 


that the poli 
closely linked to the values o 


hem seems to e 


some might call 


then Prime Minister, Anders 


taking place in t 
the word “circle 
education (Stats 


statement and 


these phenomena were previously regarded as strong democratic features of the Folkeskole. 


ntail a change of mindset (Dall 2013). It is undoubtedly the case 


tical intention was to dispense with allegedly ineffective activities perceived as 


f progressive education introduced in legislation in the mid-1970s. 
it infamous) speech in the Danish Parliament (October, 2003) the 
Fogh Rasmussen, claimed that there were far too many student 
he Folkeskole in circles that were based on uninformed opinions. 
-education” has been used as a depreciatory characterization of 
ministeriet 2003). 


the changes mentioned earlier can be seen as symptoms of an 


d toward focusing on measurable school effectiveness and academic 
pective, the class is a learning community in need of a teacher performing 


"or “management” rather than a social community where the teacher 


needs to be present as a person in ongoing discussions. In other words, the developments 


mentioned above can 


be viewed as changes to the scope of the school that indirectly also 


influence civic education (see some further discussion later in this chapter). 


A Brief History of the Reception of the Results from Danish CIVED 


and ICCS 


In 2000, be 
to perform 


subject areas from TIMSS 19 
mathematics and reading. In general, the results were interpreted as mediocre and 
below expectations. 


averages in 


particularly well 


In the CIVE 
students on 


fore the CIVED 1999 results were announced, nobody expected Danish students 


in an international comparative study. Previous results in other 
95 and PISA 2000 placed Danish students close to the international 


D 1999 study (Torney-Purta et al. 2001), the average scale score of the Danish 


the cognitive student test was very close to the international average. However, 
this was interpreted relatively positively, because most of the better-performing countries had 


tested grade 9 students, whereas Denmark had tested grade 8. The international variation was 
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rather complex. The two highest average test scores were from cou 
8 students whereas the next five listed countries had tested grade 
grade issue, some countries (including Denmark) tested both grade 


at grade 9. In Denmark, grade 9 students performed 


cognitive test. The average score for grade 9 students was on par with the very best performing 


COU 


much better than grade 8 stude 


tional sample 


ntries that had tested grade 
9 students. Foreseeing this 
8 and an addit 


nts in the 


scie 


and 


tries. It was important for Denmark to consider the grade issue 


n 
nce was a mandatory subject only in grade 9. Given this additional 
CIVED cognitive test results, the overall interpretation of the 
t 
a 


exp 


, because, at th 


e time, social 
information about the 
Danish results was relativel 
he introduction of the mandatory grade 9 social science course was put forward as a likely 
nation for the substantial difference between grade 8 and grade 9. 


y positive 


In other areas of CIVED (concerning students’ attitudes towards democracy and intentions to 


participate in po 


because, in theory, it would have been more advantageous to investigate grade 9 in 


that grade 9 is the last year of lower secondary schoo 
However, an interesting finding was that grade 9 stud 


science whereas grade 8 students would be thinking 


At the international level, the Danish results concerning students’ attitudes and 
participate varied substantially across different content dimensions. For examp 


average support for gender equality was the highes 


than 90%). Other results were not as good. For exam 


for the majority o 


Danish students expecting to vote at national elections was among the hi 


various citizen actions was very low. In most cases, 


When first announced, the results of CIVE 
conference in the Ministry of Education and televisio 


the relative strengt 


D 1999 received widespread p 


ple, the Danish students’ en 
participation in less traditional forms of political activities and activism 


students in 


ussion) in les 


ublic attentio 


itical activities) results were similar for grades 8 and 9. This was illuminating, 
ICCS, given 
Denmark. 
ents were significantly more positive than 
grade 8 students about the so-called “open classroom climate” (for disc 
concern CCE. When answering these IEA questions, grade 9 students would be thi 


sons that 


nking of social 
of lessons in history or Danish. 


intentions to 
e, the Danish 
t of all countries, and the percentage of 
ghest in Europe (more 
dorsement of 
as well as support for 
hs and weaknesses of 
the Danish results were quite similar to those of the other Nordic countries. 


n(apress 


n, radio, and written press coverage). The 


broader context for the announcement was the (alleged) poor results from other international 


studies, so there was a feeling of relief when the CIVE 
were interpreted relatively positively but did not spar 


In ICCS 2009, the average Danish student test score 


average (Schulz et al. 2010). Another important finding was that the 
average of boys from any country. The test result received some celebratory m 
including some remarkable headlines about the Danish students as 
democracy” (Ebdrup 2010). However, the public attention was lessened because the international 
findings were (pre)released during the summer holidays, and holding a press con 


unrealistic. When the final full results were released 
“breaking news” Another problem was that the media's 


month. Nevertheless, the celebratory media attenti 


was significantly above th 


D 1999 results were released. The results 
extensive debate. 


e international 
Danish boys had the highest 
edia attention, 


“World champions in 


ference proved 


in late 2010, the results were no longer 
attention (and the attention of the Ministry 


the same 


on and headlines about civic education 


of Education) was being drawn to the unexceptional results from PISA 2009, released 
e 


the results about students’ atti 


ndured for a significant amount of time. Once more, 


n 
in the international comparisons. For example, of al 
m 


the intention to vote in national elections. However, 


ost positive perception about the open classroom climate for d 
averages regarding gender equality, and the highest percentage in Europ 


intentions to participate in various activities revealed both relatively high 
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and one of the lowest averages on a scale measuri 
(Bruun 2010a; 2010b; Bruun and Lieberki 


In ICCS 2016, the Danish average kn 
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Danish educational policy from 1999 to 2018 was characterized by New Public 
tqvist et.al 2018; Krejsler 2013a, 2013b; Krejsler et al. 2018). This 


2 In Denmark, government interference in such matters is unusual and controversial. As a general rule, wages and 
working conditions are defined in collective agreements agreed upon by the trade unions and employers’ organizations 
where the state plays no part. This is known as “The Danish Model” (Lykketoft 2010). 
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can be viewed as a part of a general transformation of the welfare state into 


a competitive 


state and of the nation state into a global state (Pedersen 2011; Biesta 2011). As a part of this 
transformation, schools are expected to become effective and productive by competing. They 


must also be held accountable for their competitiveness. The NPM theoretical 


assumption is 


that the public sector (the school) will become more productive once it is forced to adapt to 


conditions that resemble those of private companies in competitive markets. 


Each school is 


expected to view itself as an actor in a quasi-school-market in which all schools, teachers and 


students comply with the same given standards (national tests and benchmarks), 
results measurable and accountable (Bogetoft et al. 2014). 


From a CCE point of view, it is interesting that NPM perceives the individual 


and make their 


as a "user" or 


“customer” guided by self-interest in her or his relationship to the state and the school system. 


In other words, the role of the democratic citizen is transformed into somet 


hing similar to 


consumer choice (Aberbach and Christensen 2005). This also implies that the task of the school in 


preparing students for their future life as citizens of society changes in scope. In N 


PM, the citizen 


is a rational economic individual driven by self-interests. Policymakers can rely on the fact that 
the citizens will strive to optimize their individual and personal gain by making rational choices. 


This line of thinking is in opposition to the values behind the Danish tradition 


of progressive 


education inculcating civic virtue and treasuring shared values, and norms (i.e., in short, the citizen 
as amember of a community and a national culture). In the late 20th century, the Danish Public 


School was Officially characterized in terms of a community, by an absence of competiti 


as relying on a sense of solidarity. Many of these ideas found their way to Denma 
(for example, from the Dewey tradition). However, the ideology of progressive 


always also resonated well with a long Danish tradition of idealizing "the living word” (a 


expression in Denmark from N.F.S. Grundtvig, 1783-1872) (Larsen 2018). 


For advocates of this progressive tradition, the true meaning of the school is a 
sense of community is practiced and experienced, especially in the classroom 
common deliberation. Here students (ideally) have an equal voice in relations 
reason, honesty, and mutual respect. As such, the main focus is on the citizen a 


n and 
broad 
n has 
mous 


v oO 


rk from 
educati 


S-O 


place where a 
as a place for 
hips based on 
s a member of 


civil society in a given cultural and local context. This contrasts with NPM ideology, in which 


marketplaces of a globalized economy. 


even nationalistic or populistic). From the neo-liberal point of view, the progre 
conservative ideology that fails to promote an up-to-date and adequate globa 
citizenry. 


This conflict permeates current educational discourse, educational practice, educat 


and educational political debate. In general, the Folkeskole in Denmark has become a veritable 
public discursive battlefield concerned with the classical conflict between civic education a 


academic achievement (for future work) and as civic/moral education (for future 


the conflict is articulated as a conflict between productive and progressive education. Proponent 


on both sides present the conflict as insurmountable in political, ideological, 


the productive and effective citizen is first of all characterized by an accumulation of individual 
self-interests and personal competencies in order to become competitive in the workplaces and 


From the point of view of advocates of the neo-liberal competitive state, the idealization 
of the deliberative and/or communitarian citizen is counter-productive and conservative 


ssive ideal is a 
ly competitive 


tional research, 


S 
ife). In general, 
S 


and scientific 


discourses. By agreeing to disagree, each side of the conflict keeps itself alive by keeping the 


opposing view alive. 


58 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


ICCS and the Future 


of the study. 


= 


The international study cen 


Nevertheless, it 


ternational cooperation at the 
also between study cycles 


development. There are constra 
to initiate discussion in this area. With this in mind, study cycles could be implemented less 
frequently. This would address another problem, namely the difficulty of recruiting schools to 
participate. There are a vast number of studies, surveys, and tests taking place. From a broader 
point of view, it might be fruitful to lengthen the study cycle by one year so that the first year after 


the release of the internat 


ters behind CIVED and ICCS have been commendable in their efforts 
to include the interests and perspectives of the national centers in the ongoing development 


might be worthwhile to consider further strengthening of 
NRC level. This cooperation could take place during studies but 


in order to widen the cross national and regional exchange of ideas 
and the implementation of the use of data in secondary analysis and follow-up research and 


ints of funding and time, but it would be appropriate for ICCS 


tional main results could remain an active year with study management 


and NRC meetings. This would give both the international and national centers more time for 


analyses and further coo 


asting effect o 
to come. Looki 


fathers) should 
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CHAPTER 6: 


Building Civic and Citizenship Education in the 
Dominican Republic 


Ancell Scheker and Michelle Guzmán! 


Abstract This chapter addresses the participation of the Dominican Republic in the IEA 
International Civic and Citizenship Education Study (ICCS) 2009 and 2016, and the challenges 
they reveal. Participation in these IEA civic studies contributed to educational discussions in 
the Dominican Republic through stimulating curricular reform in which the education approach 
recently changed from content-based to competency-based. As a result, one of the core 
competencies to be developed in all subjects and at every grade through a cross-curricular 
approach is related to ethics and citizenship; specific contents regarding citizenship are taught 
in social sciences. However, ICCS has shown a substantial gap between the intended (formal 
curriculum documents), the implemented (actual teaching process in the classroom), and the 
attained curriculum (student achievement), as well as the importance of context. ICCS serves as 
a reliable source of information for policymaking, research, and debates regarding civic education 
in the Dominican Republic. 


Background 


The Dominican Republic is implementing substantial changes in its education system. Since 
2013, it has allocated four percent of GDP to education, doubling the budget of the Ministry of 
Education. Several measures were taken to improve quality: investing more in early childhood 
education, gradually increasing instructional time, extending the school day from four to eight 
hours, reforming the curriculum and teachers’ education, among others. 


Changes in civic and citizenship education have been part of a broader transition in the system 
from a content-based approach (1995) to competency-based education (2016). The current 
curricular design, developed from 2013 to 2018, has defined competency as the “capability to act 
as an autonomous individual in different contexts; transforming concepts, procedures, attitudes 
and values in an integrated manner” (Ministerio de Educación 20164, p. 40). It establishes seven 
core competencies and specific competencies in each subject. One of the core competencies is 
named “ethics and citizenship.” This competency aims to develop in the students the ability to 
relate to others with respect, justice and equity in all settings, to question violent practices and 
those that violate human rights, and to transform society based on the principles of democracy 
(Ministerio de Educación 20164, p. 65). These changes in the curriculum focus and approach are 
the result of a complex process, and highlight the continuing importance that the International 
Civic and Citizenship Education Study (ICCS) of the International Association for the Evaluation 
of Educational Achievement (IEA) has for informing policy and debate in the country. 


n 2010, a new constitution was enacted giving a more active role to citizens. Learning the 
Dominican Constitution is an important part of the new curriculum. Moreover, a National 
Pact for the Reform of Education in the Dominican Republic (2014-2030) was agreed upon 
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Civics and Citizenship in the Education System 
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Presence of the IEA Civic and Citizenship Education Studies in 


Education Discourse and Reforms 


Curriculum 
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CHAPTER 7: 


Estonia: Civic and Citizenship Education in 
Turbulent Times 


Anu Toots and Mare Oja 


Abstract This chapter addresses Estonia’s participation in IEA’s Civic Education Study (CIVED), 
International Civic and Citizenship Education Study (ICCS) 2009, and ICCS 2016. Participation 
in these IEA civic studies contributed to educational discourse in Estonia by transforming the 
state-centered subject into broader society-centered and age-relevant concepts of citizenship. 
Study findings affected curriculum and textbooks’ content and external testing policy. Uniquely, 
in Estonia IEA civic studies had a breakthrough effect outside formal education by contributing 
to lowering the voting age to 16 in municipal elections. Finally, the chapter addresses the 
challenge and national experience of integrating Russian-speaking youth into society through 
civic and citizenship education. 


General Background Information on the Period 1999-2016 


Estonia has participated in all International Association for the Evaluation of Education 
Achievement (IEA) civic and citizenship education studies since the mid-1990s. At that time 
the majority of policymakers began to realize the importance of comparing national educational 
outcomes internationally. This broad consensus facilitated the country's participation in IEA’s 
Civic Education Study (CIVED), International Civic and Citizenship Education Study (ICCS) 
2009, and ICCS 2016. Estonia became an IEA member in 2003. Recently there is some survey 
fatigue, and every new study provokes intensive discussions about participation. Despite this, 
the decision to take part in ICCS 2022 has been confirmed. 


The participation of Estonia in international civic and citizenship education (CCE) surveys is 
part of a broader picture of societal transformation. After the collapse of the Soviet Union 
in 1991, Estonia restored its independence and launched rather radical reforms to transition 
from a totalitarian regime to a liberal democracy. In foreign affairs this meant joining all major 
international organizations—United Nations (1991), Council of Europe (1993), North Atlantic 
Treaty Organization (NATO) (2004), Organisation for Economic Co-operation and Development 
OECD) (2010), and the European Union (EU) (2004). Domestically, two areas have special 
importance for CCE: first, democratization of formal education and second, integration of Russian 
speaking schools and students. During Soviet times about 15% of lower secondary schools had 
Russian as the language of instruction, decreasing to 7% by 2016 (Statistics Estonia 2020). 


Although all schools in Estonia follow the national curriculum and use textbooks approved by 
the Ministry of Education, curriculum and teaching practices in Estonian-speaking and Russian- 
speaking schools differ. This made modernization of national curriculum even more urgent. In 
25 years, there have been several curriculum reforms that changed the status and content of 
social studies substantially. The trend throughout the entire period was to move away from law- 
centered teaching of state and government topics to the concept of democratic citizenship, which 
encompasses democratic attitudes and participatory patterns as well as knowledge. Assessment 
of students’ cognitive capacities has a long tradition in Estonian education. In CCE learning 
outcomes are assessed via national tests at the end of lower and upper secondary school. Due 


Anu Toots, Tallinn University, Tallinn, Estonia 
email: anuto@tlu.ee 

Mare Oja, Tallinn University, Tallinn, Estonia 
email: mareoja@tlu.ee 


© IEA International Association for the Evaluation of Educational Achievement 2021 77 
B. Malak-Minkiewicz and J. Torney-Purta (eds.), Influences of the IEA Civic 
and Citizenship Education Studies, https://doi.org/10.1007/978-3-030-71102-3 7 


78 


to the to 
political par 
information (Torney-Purta e 
CIVED and ICCS also stimu 
comparative studies on CC 


Some EU funded research 
MYPLACE), 2011-15, a 
EyoU), 20 
participation among you 
and current civic attitude 
revealed that youth civic engagen 
education, and socioeconomic 

the weak propensity of young 
and their greater participation 

CATCH-EyoU focused on 
in Europe (Motti-Stefanidi and Cicogna 


tarian past muc 
ticipation. | 


tali 


ated 


Ein 


projec 
nd Con 


ts, such as 
structing 


Cc 


ng peo 


h less was know 
EA civic and citizen 
t al. 2001; Amad 
interest am 
Eastern and 


15-18, have also provided reliable i 
ple. MYPLAC 
s and engagement of youn 
nent is affected pri 
status, and less by 
people to parti 
in non-conventi 


e 
AcT 


n about you 


ong researc 
Western 


mory, Yo 
ive, C 
nsights about 
E studied linkages 


young people's trust in 
ni 2018). 


cipate throu 
onal 


hers in 
rope ( 


uth, Poli 
itizensHi 


Eu 


g peop 
rily bya 
historic 


ma 


activities (Pi 
EU inst 
ndings o 


trust in alternative media is related to n 
However, both MYPLACE and CATCH- 


egative att 
EyoU differ m 
dents and using multiple meth 


by encompassing a larger age range of res 
id not measure civic knowledge. 


d 
This chapter examines the role of | 
a 


EA CC 


nd their broader impact on youth policy. 
n these multifaceted developments. An 
national research coordinator for CIVED, 
advisors in the lowering the voting age 
are Oja worked 1993-2011 in the 

and the National Qualification and 
been engaged in national curriculum refo 
in initial teacher training programs at Ta 


Exami 
i 
i 


Besi 
stra 
school related mass m 
curriculum developme 


des the authors’ expert knowledge, 


tegies, reports on n 


nt is also used. 


E ST 


ational testing in CC 
edia. Personal comm 


pon 


ES 
da 


atio 


nu 


E, h 


e ch 
ts, a 
S 2009, and 2016; 
n ex 
istry 


of 


m in the area of history a 
niversity. 


the chapter relies on n 
igher education teacher training regulations, and 
unication with experts and civil servants involved in 


titudes towards 
ethodo 


professor of Ta 


pert on curricul 
Education, the 


Development of National Curriculum Policy 


Democratization of the 
reforms in the Soviet Un 
was rep 
when ci 
acco 


subject in classrooms de 
point came in 1996, whe 
as a binding governme 
foundations of the national e 
status and language of instruct 
esta 


n the i 


Estonian school system began 
ion made open public debates possible. The Soviet-style ci 


mpanied by modern textbooks or study ma 
pended on the professional 
first national curricu 
nt decree. This document 
ducational policy th 
tion had to follow th 
blished a two-layered structure: a general par 


the grade structure of the school, and a second 


Esto 
Krzywosz-Rynkiewicz et 
tica 
p wit 
democratic at 
between t 
e in various reg 
stude 
memories. MYPLAC 
gh traditional inst 


titutions a 
n you 


ogica 


at the end of t 


Legacy 


el 


nt's polit 


Ikington 


European You 


& Civic 


th 
udes and pol 
he historical 
ions. Th 


ttit 


tical i 


titutional f 


and 


e findi 
nterest, pare 
E confir 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


th social and political attitudes and their 
ship studies have become the main source of this 
eo et al. 2002; Schulz et al. 2010; Schulz et al. 2018). 
nia, which resulted in further 
al. 2018). 


Engagement 
(CATCH- 


itical 
past 
ngs 
nts’ 
ned 


orms 


Pollock 2015). 


nd thei 
th medi 
the EU 
ly from 


ies in the modernization of social st 
apter authors have been active 
linn Universit 


r active engage 
a use indicated 
(Macek 
th 


ies in Es 


parti 


et al. 201 
civic stu 
; these stu 


ment 
that 
8). 
dies 
dies 


tonia 


cipants 


y served a 
one of 


s the 


the key 


she has been 
um developm 


ational 


n Centre as an expert in social scien 
nd social studi 


ent 
Board of 
ces. Sh 


es. S 


task forces. 
Education, 


e has 


he teaches 


ational legal acts and policy 


he 1980s when 


liberaliz 


aced by the history of philosophy, regarded as a less politici 
vic education programs were composed, 


terials. Thus, the 


aid down t 


e national curri 


part, which inc 


compulsory subject. 


subject-based structures of teaching. This holds also for CC 
upper secondary school. 


subject in lower and 


Despite huge changes in ideational approach, 


E def 


they were not 


ism and attitudes of th 
um of the post-to 
he 
at are still effective. All schools 
cu 
t, which defined basic va 
uded study programs for 
a kept the traditi 
fined as a compulsory separate 


zed su 


implem 


talitaria 
institut 


um. Th 


Estoni 


compulsory a 


bject. In 1992- 


entation of the 
e teachers. A tu 


vic educati 


nd were 


n period was enac 


ation 
on 
1993 
not 
CC 
rning 
ted 


e nation 
ues of educatio 


tional and ideati 
regardless of 
al curricul 


onal 


um 
and 
each 


onal 


CIVIC EDUCATION AND CITIZENSHIP IN TURBULENT TIMES IN ESTONIA 
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Presence of Civic and Citizenship Education in Education Discourses 


and their Influence 
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CHAPTER 8: 


IEA's International Civic and Citizenship Education 
Study and the Teaching of Civic Education in Italy 


Laura Palmerio, Valeria Damiani, and Elisa Caponera 


Abstract In this chapter, the results of Italy in the IEA International Civic and Citizenship Education 
Studies (ICCS) are briefly presented, highlighting the marginal role that civic education plays in 
educational policies and school practices in the Italian educational context. In Italy, although there 
was no specific teaching related to civic and citizenship education until 2020, the ICCS results 
have consistently been above the international average. Different hypotheses are proposed 
to explain these positive student outcomes. Two Italian experts in this field were interviewed; 
they agreed on the gap between the results of international surveys and their interpretations. 
They are of the opinion that some changes in educational policies in Italy would be valuable. 
INVALSI, the Italian institution responsible for the organization of ICCS, made a great effort 
to disseminate the results of the international surveys. Studies based on secondary analyses 
conducted on ICCS 2009 and 2016 are also described. 


Introduction 


Italy has participated in all International Association for the Evaluation of Educational Achievement 
IEA) subject studies and is one of the very few countries that has participated in all IEA civic 
and citizenship education (CCE) surveys since the Six Subject Survey (1971). Considering the 
results across IEA cycles, three important aspects emerge regarding Italy: first, Italy's consistent, 
above-average international position in civic knowledge; second, some changes over time in 
attitudes and behaviors, some of which are negative; and third, the significant geographical gaps 
in civic knowledge and attitudes between northern and southern areas. 


= 


The authors of this chapter have overseen the organization and national coordination of the 
International Civic and Citizenship Education Study (ICCS) since 2013. They have also committed 
themselves to expand the relevance of the ICCS research theme by providing schools, teachers, 
and researchers with diversified ICCS materials, such as the theoretical framework and a national 
report of the Italian main results; by organizing national meetings (described in the following 
paragraphs in detail); and by conducting secondary analyses on the ICCS data. 


This chapter is based on several sources: the data derived from ICCS 2009 and 2016, the 
ICCS 2016 international report (Schulz et al. 2018), the ICCS 2016 national report (Palmerio 
and Caponera 2018), interviews with experts in the field of CCE, national and internationa 
publications based on ICCS secondary analyses relevant to the Italian school system, and 
information retrieved from the Ministry of Education and other relevant national agencies. 
Below, the most significant results for Italy are presented (Table 1). 
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Table 1: International and Italian mean scores in IEA's civic education studies 


Italy International mean 

Mean (s.e.) Mean age Mean (s.e.) Mean age 
Civic Education Survey (1971) 22.9 14.5 24.5 14.5 
CIVED 1999 105 (0.8) 15.0 100 (0.2) 14.7 
CCS 2009 531 (3.3) 13.8 500 (0.0) 14.4 
CCS 2016 524 (2.4) 13.8 517 (0.7) 14.4 
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However, in the subsequent law, generic projects and support for schools and teachers replaced 


the introduction 


of the 


new subject that was to be taught within the history/geography and 


society/history subject areas for all educational cycles during the 2009/2010 school year, and no 
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Summary and Conclusions 


e Italy is one of the very few countries participating in all the | 
the Six Subject Survey (1971). 
e Across IEA cycles, no substanti 


EA CCE tests and surveys since 


al differences were found regarding the civic knowledge lev- 


els of students; they performed slightly above the international mean in each study. How- 
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e Two experts in this field were interviewed (Luciano Corradini and Bruno Losito), and they 


both agreed on the existing gap between international survey fin 
and educational policies proposed in Italy. 
e INVALSI is responsible for the organization, management, and im 


dings and the implications 


plementation of the Italian 


component of international surveys, and it has been making a great effort to disseminate the 
results of international surveys. Among other initiatives, INVALSI organized a public seminar 


in which the Italian results of ICCS 2016 were presented, and a s 


ummary of the results was 


shared with the media. In early 2018, the ICCS 2016 national report was published on the 


institutional website. 


e In recent years, analyses of the ICCS data, as well as those of ot 


her international surveys, 


have contributed to building a committed community of researchers. This has led to relevant 
publications at both the national and international levels based on the secondary analyses 
conducted on ICCS 2009 and 2016. 
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CHAPTER 9: 


Improving Civic and Citizenship Education in 
Latvia’ 


Ireta Cekse 


Abstract The chapter characterizes citizenship education in Latvia within the national education 
system and on the level of public interest and involvement. The article particularly focuses on 
a large school education reform carried out in Latvia since 1991. The chapter concludes with 
recommendations for further research in the field of citizenship education in Latvia, as well as for 
policymakers. As regards possible policy changes, the author suggests raising civic competence, 
and replacing the sometime exaggerated manifestations of patriotism with awareness about 
security issues, individual and democratic values, and the sense of belonging at different levels. 
In addition, an aim should be to enhance the ability to critically assess political and economic 
developments. 


Introduction: General Background Information 


Latvia has participated in international comparative studies since the restoration of independence 
in 1991. This includes the International Association for the Evaluation of Educational Achievement 
EA) and Organisation for Economic Co-operation and Development (OECD) studies such as IEA's 
TIMSS and PIRLS,? and OECD's TALIS and PISA.? Further, since 1999, Latvia has taken part in all 
of the IEA's civic and citizenship education studies: first, the Civic Education Study (CIVED) and 
then the International Civic and Citizenship Education Studies (ICCS). In CIVED 1999, students’ 
evel of citizenship achievements was very low. Students’ achievements in citizenship knowledge 
have improved somewhat over the last two ICCS surveys of 2009 and 2016. These results are 
considerable for a new democracy after 50 years of a completely different political system. 


= 


The author of this chapter, lreta Cekse, has participated in the IEA ICCS studies since 2007, 
working as a data processing manager in ICCS 2009 and as the national research coordinator 
for ICCS 2016. 


EA ICCS is the largest study in Latvia covering local, national, and international levels of 
citizenship education. However, there are also specific studies in the area being carried out to 
measure knowledge levels and explain attitudes in particular domains of citizenship education. 
For instance, before launching the pilot project of a state defense subject in schools, the Center 
for Security and Strategic Research of the National Defence Academy of Latvia organized focus 
group interviews with students where they were asked about their attitudes towards patriotism. 
n this case patriotism was defined as a constructively critical and active engagement in political 
processes with the aim to promote the common good, the well-being of the state and the people, 
as well as growth (Bérzina 2018, p. 9). The study showed that 10 to 15-year-old students were 
eener to be engaged in state matters and they were less critical of politics compared to adults. 
This implies a civic patriotism potential, which according to the researcher leva Berzina could 
be further fostered by offering advanced classes in politics and citizenship education. In 2014, 
a case study was conducted to analyze how well newcomers and children of re-immigrants 


1 Supported by the activity “Post-doctoral Research Aid” project no 1.1.1.2/VIAA/1/16/00, research applications no 
.1.1.2/VIAA/1/16/020 

TIMSS = Trends in International Mathematics and Science Study; PIRLS = Progress in International Reading Literacy 
TALIS = Teaching and Learning International Survey; PISA = Programme for International Student Assessment. 
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are integrated in local schools in Riga (Bérzina 2018). It was found that the nongovernmental 
organization (NGO) sector was more active in promoting global/development education topics 
than the policy or the academic sectors. 


Issues of citizenship education are also examined in democracy audits and research in the field of 
politics. Particularly noteworthy are studies (with adult respondents) about integration (Izglitibas 
attistibas centrs 2014; Vérse et al. 2013), national minorities in civic society (Baltic Institute 
of Social Sciences 2017, 2015; Muiznieks 2010) and identity (Rozenvalds and Zobena 2014). 


Since 1991, Latvia has carried out significant school education reforms, which are expected to 
continue at least until 2021. The aim of the reforms is to “develop, test and successively implement 
general education curriculum and approaches to the teaching of 1.54 to 18-year-olds that will 
develop the knowledge, skills, and attitudes needed for the challenges of the 21st century” 
(Latvijas Izglitibas un zinātnes ministrija n.d.). The reforms also seek to introduce competency- 
based education which includes curriculum on social and civic matters at all levels. There are 
particular skills in understanding economics, politics, and social problems that students need 
to be taught at each level. For instance, in grades 1 through 6 students study social processes 
in their local surroundings and in Latvia; the emphasis is on developing initial skills in studying 
history. Meanwhile, in grades 7 through 9 students analyze both local and global communities, 
and seek to identify what factors drive the well-being of individuals and society as a whole (Valsts 
izglitibas un satura eksaminacijas centrs 2018). 


Civic and Citizenship Education in Latvia 


Diverse aspects of citizenship education have been developed in Latvia at the school, society, 
and state levels. Both national and municipal efforts can be observed. 


n Latvia the Ministry of Education and Science is responsible for citizenship education matters, 
but also involved are the Ministry of Culture and the Ministry of Defence; the NGO sector is 
also active in this area. The Ministry of Culture is in charge of drafting and implementing national 
identity, civic society, and integration in society policy plans (Latvijas Republikas Kultūras ministrija 
2018a). The Ministry of Defence actively promotes patriotic sentiments in society, as well as 
seeking to raise awareness of national security issues. This includes fostering media literacy 
to avoid manipulation of public opinion. Meanwhile the Ministry of Education and Science is 
responsible for citizenship education in school curriculum and programs. 


As part of the agenda dedicated to the Latvian centenary, a 2017-2021 framework program 
has been launched at state and municipal level. The program seeks to promote national cultural 
values, educate society about history, and strengthen the sense of national belonging (Latvijas 
Republikas KultUras ministrija 2018b). One of the initiatives, called School Backpack (Skolas soma), 
is aimed at providing opportunities for students to attend cultural events such as theatre, opera, 
concerts, and exhibitions. School Backpack is supported by Latvia's government. Meanwhile 
the project Latvija 2018 seeks to highlight Latvian values and achievements. The conceptual 
framework of the project is based on four pillars: 1) promoting citizenship, sense of belonging to 
the state, and national identity, 2) improving quality of education for the 21st century, 3) raising 
cultural awareness. and 4) decreasing social inequalities. Project Latvija 2018 was to promote 
civic consciousness, strengthen the sense of national belonging and national identity, improve 
education, build cultural literacy, and reduce social inequality (Latvijas Republikas Kulturas 
ministrija 2018c). 


4 Formal education in Latvia starts from age 1.5, in preschool. 
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n 2005 and 2006, the Education Development Centre carried out a project within the framework 
of the International Civic Education Exchange program (CIVITAS). The aim of the project was to 
improve the quality of civic and citizenship education, to promote democracy, and to strengthen 
civil society in Latvia. During the project such programs as Project Citizen, Foundations of 
Democracy, and The Citizen and Constitution were implemented for different audiences. The 
Education Development Centre has established a support network which has helped teachers 
to implement teaching civic-related content. The Education Development Centre’s method 
cludes fostering the development of civic, intercultural inclusive education, education about 
ternational development and cooperation, encouragement of critical thinking for promoting 
diversity, participation in state policy development processes, and participation in developing 
education policy. The target groups are education specialists, employees of state and municipal 
institutions, specialists from different professional fields, representatives of NGOs, the active 
population of local communities, school youth, and socially marginalized groups (Izglitibas 
attistibas centrs 2006). 


Two NGO sector organizations actively promote civic issues. The Centre for Public Policy, 
Providus, seeks to "promote evidence-based policy and the development of open society 
values” (Providus n.d.). Providus focuses on local and international projects related to good 
governance and participation, corruption, inclusive society, international politics, and elections. 
Providus researchers very often are opinion leaders who are asked for their opinions about 
political issues in the mass media. Meanwhile the Education Development Centre (EDC) seeks 
to stimulate development of democratic society and promote civic engagement and professional 
competitiveness (Education Development Centre 2017). The mission of the EDC is to promote 
further development of an educated, democratic society in Latvia by promoting the professional 
capacity, competitiveness, cooperation, and civic participation skills of each individual. 


n the period from 2000 to 2017, citizenship education in Latvia basically was aimed at shaping the 
civic capacity of students, focusing on preparing students to make socially responsible decisions 
for individual needs and needs of society. The curricula consisted not only of theoretical, but 
also practical activities where students had to do projects and research. These activities primarily 
focused on practical engagement in local communities, like helping seniors, doing spring clean- 
ups, recycling, doing voluntary work, and participating in elections as observers. 


Social science (sociālās zinības) is designed as an integrated subject for elementary school and 
ower-school level (grade 1 to 9) comprising ethical, civic, economic, and health education. 
Social science comprises topics covering politics and law, sociology, anthropology, economics, 
psychology, and ethics. The subject is taught for 40 minutes (one lesson period) twice a week. 
At primary education level, the aim of the subject is to develop civic competence, and to study 
essential personal and social issues on individual, community, and state levels (Izglītības satura 
un eksaminācijas centrs 2014). Meanwhile, the Ministry of Defence has introduced state defence 
(Valsts aizsardzibas måciba) classes in Latvian schools on secondary school level (grade 10 to 
12). The aim of the subject has been adjusted and now seeks to promote civic consciousness 
where one of the objectives is to develop a sense of patriotism. State defence is an elective 
course which is mostly done by students who plan to pursue a military career. The curriculum 
includes theoretical and practical activities where students learn about state defence, service 
in the Latvian National Armed Forces, develop a sense of patriotism, civic consciousness, and 
work on their physical condition (Aizsardzibas ministrija 2013). 


n 2016, the Ministry of Education and Science launched a large school education reform which, as 
mentioned earlier, is expected to be finalized by 2021. The reform seeks to introduce competency- 
based curricula in schools. The reform also covers social science where the new curriculum 
would focus more on defining multi-skill competences. As regards citizenship education, one of 
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the objectives of the new curriculum is to promote national patriotism which, along with other 


objectives, is done throug 


h social and civic domains, cultural awareness, self-expression, natural 


sciences, math, technology studies, health studies, and physical activities.° 


Social and civic competences are taught in 


science and history, and L 
to social and civic domains: 


Six hours per week, from age 6 to 9 (gra 


social science, as well as in separate modules: social 


atvian and world history. The teacher guidelines recommend devoting 


de 1 to 3); 


Six hours per week from age 9 to 12 (grade 4 to 6); and 


Eleven hours per week from age 12 to 15 (grade 7 to 9) (Baunte et al. n.d.). 


Guidelines allow teachers to use textbooks and other study materials such as internet resources, 


documents, and working papers in socia 


students’ civic competences thus buildin 


th 


consequences of one’s choices and actions, 
and freedom (Valsts izglitibas un satura eksaminācijas centrs 2018). 


Schools offer civic activities where students 
schools in Latvia have elected student councils. The councils seek to defend students' interests, 


Q 


science classes. These classes are aimed at advancing 


g their social responsibility at different levels. In 


is context social responsibility is understood as a willingness and ability to understand the 


and act in a way that respects other peoples’ dignity 


can practice different aspects of democracy. Usually 


rganize different activities (spring clean-ups, sport and entertainment activities, charity events, 


activities during national holidays), consider whether students’ rights are being observed, and 
improve school life by proposing specific initiatives. 


Teachers of Civic and Citizenship Education 


One of the following requirements needs to be met to qualify for a teaching position in Latvia: 


degree in pedagogy with teacher’s quali 


fication in the corresponding study subject; 


degree in the field of science or social science corresponding to the study subject and teach- 


er’s qualification; 
master’s degree or PhD in education or 
corresponding study subject and didacti 


pedagogy if the written dissertation is related to the 
cs; and 


degree in the field of science corresponding to the study subject and professional experi- 


ence in an educational institution, which 
a mentor (Ministru Kabinets 2018). 


does not exceed one year, under the supervision of 


These requirements also apply to the qualification of social science teachers. A teacher can 
btain the qualification of a social science teacher upon completing a 160-hour course in social 
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science at the University of Latvia. 


As mentioned above, since 2005, the co 


p 


Pan 


S 
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p 
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ntegrated into social science curriculum. 


rograms that qualify candidates to teach thi 


ntent of civic and citizenship education has been 
Four higher education institutions in Latvia offer 
s subject, including a four-year professional bachelor’s 


rogram or a second-level professional study program following the completion of a Bachelor 
Education. It is possible to obtain a qualification as a social science teacher together with a 
ualification of a teacher of history, history of culture, geography, or another civic-related subject 
Augstakas izglitibas kvalitates novertesanas centrs 2005). 


tandards for social science teachers are closely related to the duties and tasks required. There are 
so standards concerning the working environment and the requirements, skills, and knowledge 


that are necessary to undertake their professional work. The standards define that teachers need 


5 In the new curriculum the desired study results in each of the domains (social and civic domains, cultural awareness, 
self-expression, natural sciences, mathematics, technology studies, health studies, and physical activities) are split 
into three school levels starting from the age of 2 (primary school) up to grade 12 (age 18). 
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substantive knowledge in pedagogy, health education, ethics, civic education, and economics. 
Social science teachers (sociālo zinību skolotājs) should have a desire to participate in society, 
understand democracy, and demonstrate tolerance in order to succeed at their pedagogical work. 
The teacher's guidelines include the following specific teacher responsibilities: 


e To include up-to-date information about civic society and political processes in the teaching 
and learning content; 

e To integrate the achievement of different fields of social studies; 

e To analyze social, economic, and political processes; 

e To organize a health-promoting school environment; and 

e To integrate the topics of economic, ethics, health, and civic education (Valsts izglitibas un 
satura eksaminācijas centrs 2018; Augstakas izglitibas kvalitates novertesanas centrs 2005). 


The requirements for obtaining teacher qualifications for social science and for professional 
development are the same as for teachers of other subjects. 


The International Civic and Citizenship Education Studies in Education 
Discourse, Their Influence 


Three study cycles have allowed monitoring the growth dynamics of Latvian students from 1999 
to 2016. In this period, there have been multiple changes in the content and methodology of 
citizenship education studies. Over the last two years, the study results have also been presented 
to the ministries (Ministry of Defence, Ministry of Foreign Affairs, Ministry of Education and 
Science, and Ministry of Culture) dealing with civic matters, citizenship education, national 
identity, and security issues. 


Questions for the ICCS 2016 national survey were drafted together with the Latvian Ministry 
of Defence. The questions comprised sections on state security, integration and understanding 
of patriotism. The results of the national survey were considered when preparing the state 
defense curriculum which was then coordinated with the Latvian Ministry of Education and 
Science. National and international results of ICCS 2016 were also used by the Division for 
Social Integration and Development of Civic Society at the Latvian Ministry of Culture in drafti 
the National Development Plan. The Ministry of Education and Science also used the ICC 
study results in preparing the school curricula reform, School 2020. The ICCS results regardin 
students’ achievements and attitudes were taken into consideration when drafting the curriculu 
for citizenship education, particularly focusing on loyalty towards the state, civic involvemen 
and views about the political system in Latvia. The results were selected and presented takin 
into account the interests and specifics of each of the institutions. This included examining th 
results of students’ achievements and attitudes in ICCS 2009 and ICCS 2016 compared to th 
democratic states of the Baltic Sea region. 
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For instance, the authors of the School 2020 reform (formulated in 2018) sought to include 
civic competencies, measured in ICCS, in the new curriculum of citizenship education. This was 
based on the results from the 1999 and 2009 IEA civic education studies (CIVED 1999 and 
CCS 2009) which were very consistent in showing the poor performance of Latvian students 
when compared internationally. Out of 28 countries participating in CIVED, the Latvian students’ 
civic knowledge scores ranked 26th (Torney-Purta et al. 2001). Ten years later the Latvian 
nowledge scores in ICCS 2009 remained very near the bottom of the ranking (Schultz et al. 
2010). Similar findings were observed in these two studies for a number of attitudinal dimensions 
where Latvian students had scores at or near the bottom of the country ranking in trust in 
government and positive attitudes toward the nation. Going to a context closer to their everyday 
life, students also reported little sense of the value of participation at school and were unlikely 
to see their classrooms as places where respectful and open discussion took place. Whether or 
not these findings became an explicit part of the decision-making process in Latvia, they served 
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as background motivation. There was some influence of the study on the broader educational 
discourse and decision making about positive steps that could be taken (such as those detailed 
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The new curricula cover aspects of citizenship education within seven domains: Social and civic 
domain, cultural awareness, self-expression, natural sciences, math, technology studies, health 
studies, and physical activities. 


As of 2023, state tests are expected to be organized for students of grade 4, 7, 8, and 10. 
eanwhile students finishing grade 9 (primary school) will need to take an inter-disciplinary 
test comprised of elements of social science, citizenship education, natural sciences, and 
technologies. At the end of secondary school, they will have an opportunity to demonstrate 
their civic competences in a course called writing a research or creative paper, where students 
are allowed to choose their topics freely. 


inority school® reform, which sought to gradually make the official state language the main 
anguage in the study process, has been relatively successful. Comparing ICCS 2009 and ICCS 
2016 (Schulz et al. 2010; Schulz et al. 2018), students’ results categorized by language have 
equalized. In 2009, the knowledge test result of Latvian-speaking students was higher by nine 
percent. Nevertheless, Russian-speaking students also demonstrate lower results in democratic 
attitudes. The national survey conducted within the framework of ICCS 2016 highlighted national 
issues in terms of citizenship education. The survey results showed that students in Latvia are 
currently less concerned about migration issues. 


After studying the international and national results of ICCS 2009 and ICCS 2016, in 2018 
the Ministry of Defence together with the Ministry of Education and Science launched a pilot 
project introducing state defense classes in 13 schools in Latvia. These classes are an optional 
career subject, whereas for students of grade 7 to 9 it is one of the topics for research works 
during special science weeks. The subject is held once per month for several hours. The aim of 
state defense classes is to prepare students for military careers in the future. Since 1997, state 
defense has been an optional subject in schools. Since 2011, state defense has been a vocational 
subject (Aizsardzības ministrija 2013) supplemented with training in the Youth Guard (Jaunsardze). 
n 2017, state defense classes were organized in 17 general schools and one vocational school 
in Latvia. State defense classes are part of the new competency-based education, seeking to 
promote civic consciousness and patriotism, as well as offering basic military skills (Mirbahs 2018). 


Summary and Conclusions 


n IEA’s ICCS 2016, grade 8 students from Latvia scored the lowest in the citizenship education 
test among all democratic countries of the Baltic Sea region that took part in the survey. The 
results of ICCS 2016 suggested that students’ civic competencies can be improved by diversifying 
the teaching methods, through more opportunities for cooperation between students and local 
municipalities in contributing to solving local problems, as well as through cooperation among 
teachers themselves. These ICCS 2016 results have been taken into account when improving 
the citizenship education curriculum in Latvia (Cekse 2018). 


As regards the current situation with citizenship education in Latvia, the chapter mentions several 
aspects. For instance, project Latvija 100, planned for the period from 2017 to 2021, seeks to 
develop initiatives aimed at promoting national cultural values, knowledge in history, and sense 
of belonging among the people in Latvia. The chapter also describes the efforts of the NGO 
sector and several ministries in terms of citizenship education, as well as looking at national-level 
studies which are directly or indirectly linked to citizenship education. 


6 Minority school (mazākumtautību skolas) refers to a school with bilingual teaching in both the official state language 
and a minority language; 25.4% of the total population of Latvia are Russian and 27% of all schools has Russian as a 
language of instruction. 
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CHAPTER 10: 


Contributions of the IEA's Civic and Citizenship 
Studies to Educational Discourse in Lithuania: The 
Past Three Decades 


Rita Dukynaité, Ginta Orintiené, Šarūnas Gerulaitis, and Marius Iziumcevas 


Abstract Citizenship education in Lithuania was introduced after the restoration of independence 
in 1990. Through the implementation of civic education policies, Lithuanian educators emphasized 
this topic in general education programs (1994, 1997, 2004, and 2008). Lithuania participated in 
IEA’s Civic Education Study (CIVED) in 1999 and International Civic and Citizenship Education 
Study (ICCS) conducted in 2009 and 2016. Since 2007, Lithuania has been collecting data to 
construct a national Civic Empowerment Index. This chapter presents how participation in IEA's 
civic and citizenship education studies has assisted Lithuania in ensuring that civic education 
can help students to become citizens who understand their rights and responsibilities, are able 
to engage constructively in society, and improve society through local activities. 


History of Civic and Citizenship Education in Lithuania 


Citizenship education in Lithuania was introduced after the restoration of independence in 1990. 
Through the implementation of specific civic education policies, Lithuanian educators emphasized 
this topic in general education programs (1994, 1997, 2004, and 2008). Two early civic education 
programs included objectives like the formation of national consciousness, commitment to the 
country, and development of the skills needed to live in a democratic society. At that time after 
the collapse of Communism, the main themes of educational content related to the culture of 
Lithuania, and history of freedom of the nation remained important. Specifically, civic education 
in Lithuania after the restoration of independence attempted to help students understand the 
responsibilities of, and develop skills as, citizens in a free nation. In 2004, Lithuania prepared 
its application to become a member of the European Union. A new civic education program 
focused on the knowledge of the universal principles of democracy, tried to examine the subject 
of patriotism and re-examine the attention to national history and identity. Subsequently the 
main aim according to the Citizenship Education Program (2008) and the Integration Program 
of Citizenship (2008) was to encourage students to develop the characteristics necessary for 
active and responsible participation in the life of democratic Lithuania and its civic society. 


International and National Studies on Civics and Citizenship 


Lithuania participated in the International Association for the Evaluation of Educational 
Achievement (IEA) study on civic education, the Civic Education Study (CIVED), in 1999. IEA’s 
International Civic and Citizenship Education Study (ICCS) was conducted in 2009 and 2016, 


and Lithuania participated in both of these studies too. 


The authors of this chapter were involved in the IEA ICCS project: Dr Rita Dukynaité (Ministry of 
Education, Science and Sport) as a national coordinator and member of IEA’s General Assembly; 
Ginta Orintiené (National Agency for Education), Sarunas Gerulaitis (Education Development 
Centre), and Marius Iziumcevas (Ministry of Education, Science and Sport) as experts on civic 
education. 
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Since 2007, Lithuania has also been collecting data to construct a national Civic Empowerment 
Index for adults. This was initiated by the Civic Society Institute and data were collected by 
TNS Gallup (published in 2007). At the request of the Ministry of Education, Science and Sport, 
researchers were asked to survey two additional sub-groups, pupils and teachers, in 2016. The 
Civic Empowerment Index survey measured four dimensions: interest in current and future 
civic action, conception of civil society’s influence, and perceptions of the risks of civic activity. 
Preferences for strong leaders were examined as well as the potential of democracy in the country. 
A study carried out in 2009 concluded that Lithuanian students and teachers had a somewhat 
higher sense of civic empowerment than other parts of society. In 2014 students’ perceptions 
of their interest in public affairs were even higher than two years earlier. 


5 


2012, the Institute of Civic Society also conducted an interview study about the condition 
f civic education in Lithuanian schools (Ziliukaité et al. 2012). It showed that many students 
id not understand the relevance of the information that they received from lessons about 
citizenship, they were more interested in the civic processes going on around them. However, 
teachers of the subject often reported not feeling competent to discuss political or economic 
issues. While they believed in schools' opportunities to develop citizenship, both through formal 
and informal activities, they also believed that the development of citizenship should be guided 
by a more coherent plan. 


O 


a 


The 2016 Civic Empowerment Index focused on students' civic activity and attitudes. Although 
the average perception of influence index increased in all age groups, perceptions among the 
younger population increased even more than among older groups. Compared to the whole 
society, young people were more likely to perceive that they have potential civic influence, and 
they were also somewhat more willing to work to solve various social problems. lt appears that 
the civic power of young people can be enhanced by their participation in public organizations 
and in civil activities, and these are not limited to school-related activities. Non-school- 
related activities can consist of, for example, active participation of young people in various 
youth organizations, voluntary activities, and non-formal education activities outside school 
(participation in discussions, debate and civic initiative clubs, local lore, ethno-cultural and other 
activities). For example, Kaunas Jesuit School planned to develop students' psychosocial skills and 
create conditions for gaining social experience through internships in various non-governmental 
and other non-profit institutions in Kaunas city. 


Changes in the Country and Educational System that Could have 
Influenced Civic and Citizenship Education 


The Law on Education of the Republic of Lithuania (2015)! states that schools should help 
students to “be active members of the civic society,’ and “to develop the necessary values to 
become patriotic persons, to convey the fundamentals of national and ethnic culture, to provide 
conditions for a mature national self-consciousness, to guarantee the continuity of the nation and 
culture of the country, to acquire foundations of civic and political culture embodying democratic 
traditions, to develop abilities and experience necessary for a person as a competent citizen 
of the Republic of Lithuania, a member of the European and of the world community, and of a 
multicultural society.” The child must realize that there are many cultures and ethnic groups living 
in the Lithuanian community, with whom they need to communicate. Referring to the historical 
context, remember that the Grand Duchy of Lithuania (1236-1795) was explicitly based on 
multilingual and multicultural principles, which meant that its citizens sought to understand and 
appreciate the identity and importance of the nation. 


1 Republic of Lithuania Law on Education, l-1489 https://e-seimas.Irs.lt/portal/legalAct/It/TAD/df672e20b93311e5b 
e9bf78e07ed6470?jfwid=4t02bsoca $ Article 43. School activity. (2015-12-22). 
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This conceptualization also reflects recent influence from groups within Lithuania, from the 
Council of Europe and to some considerable extent from the framework and findings of IEA’s civic 
education studies of 1999 and 2009. Citizenship education, as one of the most important goals 
for education, was also envisaged in the Lithuanian Progress Strategy, Lithuania 2030 (2012), 
and the 2016-2020 Intercultural Action Plan of Citizenship and National Education (2016). 


Achieving General Goals of Civic and Citizenship Education 


Since Lithuania regained its independence, civic education has been designed to educate citizens 
who are able to engage constructively in discussion and improve society through local activities. 
Schools’ aim is to develop students’ understanding of the history of the nation, its cultural 
identity, and commitment to the people of Lithuania and the state. Also important is to provide 
the knowledge and skills necessary for active and responsible participation by individuals in the 
life of the democratic state of Lithuania and in civil society. A number of citizenship education 
projects have been implemented to improve the direction of citizenship. 


The General Program of Citizenship Education helps students develop their practical skills of 
responsible civic participation by actively engaging in the life of civic society. Participation in 
analyzing and addressing social problems in school and local communities is encouraged. 


Students have the opportunity to participate in organizations, projects, and campaigns, as well 
as in school governance. Direct student self-government is implemented, for example: at the 
class level, students are given the opportunity to decide where to go during the tour, how to 
use the funds, etc.; at school level, activities take place such as organization of a referendum on 
school uniforms; and, finally, individual initiatives are also encouraged, such as students initiating 
a Christmas goodness campaign. All students of the school (class) have the right to decide/vote 
and initiate. By exercising the right of self-government, students can directly contribute to the 
improvement of their environment, school microclimate, problem solving, and the establishment 
of common rules and procedures. 


These experiences also give them opportunities to develop a sense of unity. By actively 
participating in school self-government, students develop their social skills, learn how to work 
n a team, develop their ability to constructively solve problems, and develop skills as leaders. 
The Lithuanian Student Union is a national, democratic, and nongovernmental organization 
representing the interests of Lithuanian university students. The Union develops and implements 
projects aimed at improving the academic and social situation of students as well as organizing 
seminars (or other training activities) and forums. The Union is also an active member of the 
European Union of Students (ESU) and is a founder of the Baltic Association of Student Unions 
BOM). 


The general education curriculum for basic and secondary education provides for the following 
citizenship education opportunities: 


The school is expected to combine formal education (history, geography, civic education 
classes, economy and entrepreneurship) with informal, practical school activities promoting civic 


engagement, developing the ability to make decisions and motivation to participate in school 
and local community activities. These activities should help students to use their theoretical 
knowledge in practice, e.g., when cooperating with children and youth organizations, as well 
a 
a 


s learning about adults’ interest groups and government institutions. Activities of social caring 
so help students to develop respect and concern. Some of these social-civil activities are 
compulsory and are included in the curriculum from age 11. 


In order to improve students’ knowledge of their municipality and of Lithuania, it is recommended 
to organize part of history and geography in out-of-school environments (museums, historical 
places, local self-government institutions, protected areas), and also to use virtual learning 
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(lower) secondary, and upper secondary education programs, do not exist as a separate type of 
general education institution. 


At secondary school, the development of citizenship, national identity, and promotion of social 
action includes all areas of formal and non-formal education. For example, we could see the 
development of citizenship in these various fields: in teaching of the citizenship subject in grades 
9-10, in the integration of civic problems into the content of other subjects and community 
life, in social-civic activities, and in non-formal education activities. Compulsory social-civic 
ctivities are allocated at least 10 hours (lessons) per school year, but individual schools can 
locate more time. Schools may devote sufficient time to research, problem solving, or other 
ubjects to ensure full citizenship education. Students develop their research abilities by using 
heir existing knowledge in the community. They learn how to initiate changes to solve problems 
hat arise. In Lithuania, the Civic Empowerment Index has been carried out and it shows that 
tudents believe that they have more civic power than other members of society and that it is 
beneficial to the whole society. 


a 
a 
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The General Education curriculum in primary, lower secondary, and upper secondary education 
levels includes the following subjects: democratic state and civic society, democratic values and 
civic society, Lithuania as a state of laws, and Lithuanian identity in the context of the international 
community. The program highlights knowledge and understanding, social participation and 
collaboration, problem solving, and communication skills. 


A strong Lithuanian national identity of an independent state willing to stand up to preserve its 
culture and language has long prevailed in the country. This emphasis is maintained throughout 
the educational process (and accounts, for example, for subjects such as the history of freedom 
fighters). This national emphasis has not been a focus in the IEA civic studies, and that may be 
one reason why the studies have not had more influence on the Lithuanian educational aims 
and activities. However, participation remains useful because we can locate ourselves in the 
context of participating countries and see the issues that are discussed elsewhere regarding 
citizenship education. 


Conditions of Citizenship Education in Schools 

A Civil education implementation policy: objectives, instruments, results study conducted in 2013 
showed that textbooks, printed teaching materials, handouts, and video recordings are often 
used in teaching civic education (Svietimo aprúpinimo centras 2013). 


An external evaluation by the National Agency for School Evaluation was conducted of the 
quality of school ethos, school self-governance, and the school’s role in the local community, 
along with formal lessons on citizenship (Nacionaliné mokykly vertinimo agentura n.d.). According 
to external evaluation data from 2017 and 2018, citizenship lessons evaluation average is 
2.46 in grades 9-10 (on a 4 point scale). The evaluation average of citizenship lessons is lower 
than the geography lessons (2.51) and higher than history (2.40) and economics (2.29). The 
average evaluation of the lessons of these subjects (physical culture—2.64, art-technological 
education—2.61, information technology—2.58, mathematics—2.55, nature sciences—2.55, 
Lithuanian language—2.53) are higher than citizenship lessons. Two educational paradigms 
prevail in civic education lessons: traditional teaching often lecturing or textbook based (45% of 
the lessons taught) and attempting to work in a less traditional way by activating the student's 
interest and effort in the subject and responsibility for learning (37% of the lessons). 


n the national external evaluation of the quality of school activities, which takes place every seven 
years, each school is assessed in terms of citizenship activity. Membership in organizations and 
the community (73%), and the school staff culture of cooperation (58%) were rated at the top 
grade of 3 (good) when assessing the whole school’s contribution to citizenship. These results are 
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2 Itis recommended that students collect evidence of their socio-civic activity themselves using e-mail folders, for 
example in the Open Information Counseling Guidance System (AIKOS). 
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joined the project Solidarity Schools in the Baltics implemented by Humana People to People 
Baltic. In 2014, the project entitled “The provisions of sustainable development and development 
cooperation strengthening in the country's general education schools" was implemented. Global 
Education in School Life was implemented in 2015-2016. 


Teachers of Civics and Citizenship 


Teachers who completed history, sociology, law, and/or political science degrees and teachers 
of geography or economics can teach the subject of citizenship without specific further training. 
However, teachers of citizenship fundamentals and teachers of social education subjects, who 
integrate citizenship education into their teaching, also have opportunities to participate in 
additional training. Between 2007 and 2017 specific programs were offered covering media 
and information literacy, national security, and the basics of citizenship (especially for schools 
where students speak Polish and Russian). There were opportunities for teachers to improve 
their qualifications. In Lithuania several hundred teachers have already participated. 


Qualitative research using interviews on the status of citizenship education in 2012 revealed 
that some Lithuanian civic education teachers lack self-confidence in teaching about civics 
and citizenship. They are especially uncertain about serving as models of citizenship for young 
people. Teachers feel vulnerable to political circumstances. The Ministry of Education, Science 
and Sports is still trying to ensure that schools are not a political battleground, so in order to 
avoid this, they provide various consultations and trainings in order to be less affected by negative 
political decisions. The hope is to ensure political equality, in part by organizing civic events where 
representatives of all political positions are invited so that students are acquainted with politics 
and its diversity. Teachers feel that they do not have enough competency to discuss politics 
with students or help them understand the political life of their country (or other countries). This 
problem is made worse by the extent of economic and social problems in Lithuania. 


Teachers noted that they feel there are discrepancies between ideals and reality. Often what 
is written in textbooks differs from what teachers know to be the real-life circumstances of the 
country and of students. 


Presence of Civic and Citizenship Education Studies in Education 
Discourse: Their Influence 


After publication of the results of each of the civic and citizenship studies (CIVED 1999, and 
ICCS 2009 and 2016), the conclusions and recommendations were disseminated to relevant 
groups and discussed. Efforts are being made to include recommendations in the Medium-Term 
Strategic Plans for Education. The curriculum was updated in 2008, and the update took into 
account recommendations and evaluations. 


According to the conclusions of the CIVED (1999) study, the level of civic competence of 
Lithuanian adolescents was low, probably related to the ineffective implementation of new 
education strategies. This stimulated decisions at the national level to increase the number of 
hours devoted to civic education. Since 1999, two hours weekly have been devoted to civic 
education (an increase from one hour). This included the introduction of obligatory social-civic 
activities for the public. These are activities where students can act individually or in a group for 
the benefit of society. This may include organizing for the environment, volunteering in various 
civil organizations, and helping grandparents and engaging in other activities that benefit society. 


After the release of the ICCS (2009) study results, which showed a lack of civic participation and 
political literacy, there was an increase in compulsory hours for social civic activities in grades 
5-10. From 2015, social-civic activity was assigned for five hours during the school year and 
from 2017 no less than 10 hours. Social-civic activity is a pupil-selected activity that promotes 
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where they share responsibilities, and pursue common professional goals. Another is reflection 
within the school community on how to establish an open and respectful classroom climate, on 
self-assessment, and on planning. Finally, there is promotion of staff training incentives along with 
openness of the school organization to partnerships, joint projects, and using alumni networks. 


The teachers’ associations have been active. Since 2018, Pedagogical Centres have been 
established to improve staff qualifications. Beginning in 2016 teachers have had the opportunity 
to take civic education classes at the Centre for Civil Education, which interactive exhibitions 
seek to answer questions about how a democratic state and its institutions operate, how citizens 
can participate in governance, and how issues that are relevant to the whole society or loca 
community can be solved. The set of educational material is composed of 16 lesson plans in 
citizenship, history, geography, Lithuanian language, ethics, religion, and primary education. 
The permanent exposition at the Centre is complemented by periodically updated thematic 
exhibitions introducing the most important symbols or events of statehood. The information 
presented at the Centre for Civil Education is being developed together with visitors: with modern 
technologies, everyone is invited to develop a personal relationship with the material provided 
and share views, turning the spaces of expositions into a discussion forum. 


Role of the Studies for Recognition of School as a Community 


Participation in civic and citizenship studies gave an impetus to thinking about projects to be 
developed. An important aspect is that civic education seeks to shape national identity so as to 
develop certain values and form a civic society. The emergence of self-governing organizations 
and the involvement of the community in Lithuanian schools started with the beginning of 
independence. In 1991, the Law on Education established the powers, rights, and duties of the 
education community. Competitions and also projects of ethnographies and cultural heritage 
contribute in order to get to know the environment around us better and to get to know our 
history better. These events, financially supported by the Lithuanian state budget and EU funds, 
remain popular among students and teachers. 


Examples of civic education competitions: 


“The strength of the past for the present” competition is organized by the Ministry of National 
Defence, Vilnius University, and the Association of History Teachers. Its aim is to develop the 
citizenship of young people and promote the knowledge of history; there is also a competition 
on history of the fights for freedom and loss of Lithuania. 


“Clear Language is a Clear Head” competition is conducted by the Lithuanian Language 
Commission. The aim is to develop students’ linguistic competences, responsibility for the 
Lithuanian language, and the desire to preserve it. 


« 


European Union exam” is designed for citizens who are interested in the history of the EU, its 
institutions, culture, languages, etc. 


Examples of civic campaigns: 


“For Lithuania and me” is a campaign dedicated to the 25th anniversary of the restoration of 
Lithuania's Independence organized in 2015. The students, together with all the citizens of 
Lithuania, wove three-coloured (yellow, green, and red) friendship bracelets, also donating to 
each other’s, and corded bracelets on Gediminas’ sculpture (which was created specifically for 
this purpose). 


« 


Darom (Let's do it)” is an international campaign dedicated to environmental issues, development 
of volunteering, and community. Lithuania was one of the first countries to join this movement 
in 2008. Lithuania has accumulated extensive experience in organizing massive environmental 
work. About 45 thousand volunteers (including students) participate every year. 
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“The Constitution is alive” is a campaign dedicated to the ratification of the Constitution with a 
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The visions of being a member of society and being member of a nation are inseparable. In one 
case the public, social aspects are highlighted, and in the other case national and ethnic aspects. 
An important aspect of some projects is to promote national identity. CODE-NEMUNAS was 
implemented in 2018 to commemorate the 100th anniversary of the restoration of the state of 
uania and to help better understand the native land and its people. Summer courses have 
been held in Lithuanian regional and national parks. 


“Understand the State” (implemented in 2017) aims to introduce students to various areas of 
public life in Lithuania, to discuss relevant national and regional problems, and to consider how 
to solve them. The national minority schools were involved in the "Understand the State" project. 


School teams visited various government institutions, met with public figures, politicians, and 
civil servants, discussed specific issues about the state, the city, or the community, and possible 


solutions to them. There are some examples of problems in local communities where progress 


toward solutions was made. 


The project “Creating the Republic” (2012-2015) is one of the most prominent national civic 
education projects. Its aim was strengthening of the school community, developing civic 
competence, and mobilizing the civic potential of schools and local communities. Schools 
and local communities could be viewed as small republics—independent, democratically 
cooperative societies. Law, public policy, nongovernmental organizations, and other experts 
helped them identify important problems including local and national issues. During the project 
implementation, practical ways to solve them were discussed. During the project, 120 civic 


projects were implemented, and the three most successful ones were offered as national project 


un 


to all Lithuanian schools. The results of the project were evaluated by experts who prepared 


recommended methodologies for updating citizenship education. 


An “Educational European Parliament” was implemented in 2005. The aim of the project is to 
provide Lithuanian young people knowledge about institutions of the European Union, policy 
and decision-making procedures, processes of European integration, and to develop young 
people's self-consciousness not only as citizens of Lithuania but as citizens of EU. Many of 


these results are synergistic. 


“Open Code: CITIZEN” is a project implemented in 2011-2013 the aim of which is to provide 
educators with competence to develop active and participatory citizenship based on the 
principles of non-formal education, to develop the skills of young people in practical activities, 
and to increase their opportunities and motivation to initiate socially meaningful activities. 


for teacher preparation. 


t was designed to draw the attention of senior year students to their ability to improve the 
environments in which they and their relatives live, study, and work. This included a component 


Every Lithuanian child who is going to start first grade in Lithuania or abroad receives a “first- 
class student passport” which contains symbols of the state of Lithuania, historical events, and 
the facts of the present that promote the pride of the state. This passport, as a sign that you are 


a citizen, a resident of the country, indicates that you have rights and duties. 


EDUCATIONAL DISOURSE IN LITHUANIA 


“For clean land and clean water” was a project implemented in 2012-2014. The aim was to 
implement the Lithuanian sustainable development priorities, to actualize the use of natural 
ape by examining scientific findings. A project website was 


resources, and to protect the landsc 
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the atmosphere, hydrology, and land cover are also carried out; 55 schools in Lithuania actively 


participate in the GLOBE program. 


The Baltic Sea Project is part of UN 


ESCO Associated Schools (and includes about 30 schools). 


The project is designed to unite the schools in the Baltic countries to find solu 
environmental problems. Students conduct observations with their teachers. The aim of the 
project also is to encourage interest in environmental issues in the region, 


scientific, social, and cultural aspects of interdependence between humanity and the environmen 
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CHAPTER 11: 


The Role of IEA’s Civic and Citizenship Education 
Studies in Mexico’ 


Maria Eugenia Luna-Elizarrards, Maria Teresa Meléndez-Irigoyen, and Citlalli 
Sånchez-Alvarez? 


Abstract This chapter addresses the participation of Mexico in IEA's International Civic and 
Citizenship Education Study (ICCS) 2009 and 2016 cycles. How participation in these IEA civic 
studies, its framework, and results contributed to educational discourse in Mexico is shown in 
three ways: as a reference for emerging global trends in civic education teacher training programs; 
as a resource for independent, state, and national research projects; and as an important source 
of information for Mexico's Public Education Secretariat which helped reshape and define the 
competencies for the basic compulsory citizenship education program reforms since 2010. 


Citizenship Studies and Assessments in Mexico 


There is a broad scope of materials relevant to understanding Mexico's participation in national 
and international studies related to the topic of citizenship. Various types of surveys, assessments, 
questionnaires, and other instruments have been used in assessments to gather a wide array of 
information from adults and young people. Mexico participates in two important international 
studies related to citizenship that focus on adults. The first is the World Value Survey (WVS), 
which has been administered during seven cycles, beginning in 1981 (World Values Survey 
Association 2018). The second study is Latinobarömetro (Latin barometer); it is an annual survey 
that involves 18 Latin American countries and monitors the development of democracies, 
economies, and societies using indicators of attitude and behavior (Latinobarömetro 2018). These 
studies are conducted with adults and ask only a few basic questions about their knowledge of 
political topics. At the national level, information about civic matters has been gathered from 
adults. These include the Country Report on The Quality of Citizenship in Mexico (Instituto 
Federal Electoral and Colegio de México 2015) and the National Survey on Political Culture and 
Citizenship Practices (conducted in 2001, 2003, 2005, 2008, and 2012). These are coordinated 
by the Secretary of the Interior (Secretaría de Gobernación 2012). To broaden the information 
base, a sample of grade 8 students (second year of basic secondary school) participated in the 
ast two cycles of the International Civic and Citizenship Education Study (ICCS) (2009 and 
2016), which was coordinated by the International Association for the Evaluation of Educational 
Achievement (IEA). From this, two national reports have been published (Sistema Regional de 
Evaluacion y Desarrollo de Competencias Ciudadanas 2011; Conde et al. 2018). 


1 The opinions expressed in this chapter are those of the authors. They do not purport to reflect the opinions or views 
of the SEP, Mexico's educational authorities, institutions or its members. 

2 María Eugenia Luna-Elizarrarás participated in ICCS 2009 as Coordinator of International Quality Control and is a 
collaborating author of Mexico's ICCS 2016 national report. María Teresa Meléndez-Irigoyen is a collaborating author 
of Mexico's ICCS 2016 national report and policy briefs pertaining the use of results of ICCS and civic education 
outcomes for the Public Education Secretariat (SEP), in her Doctoral thesis she developed a civic education reference 
framework for Mexico using ICCS 2009 data. Citlalli Sånchez-Alvarez is also a collaborating author of Mexico's ICCS 
2016 national report and civic education policy briefs and has been a principal investigator in secondary analysis 
research studies that used ICCS 2009 and 2016 data. 
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Some previous research in Mexico has centered on students’ views of citizenship. The most 
emblematic is The Politicization of the Mexican Child. It examined the political attitudes of Mexican 
students from grades 5 to 9 and opened a new research area on political socialization (Segovia 
1975). Also important is the Children and Youth Survey, administered every three years since 
2012 and coordinated by the National Electoral Institute (Instituto Nacional Electoral [INE] 2017). 
This institute places ballot boxes in different parts of the country so children and teenagers from 
age three to 17 years can draw or write down their perceptions and opinions of different topics 
related to citizenship. The last cycle, for instance, asked participants to express their ideas about 
topics such as trust, security, and justice (INE 2017). It is interesting that some results from the 
adult and children’s studies are similar in identifying the issues of interpersonal and institutiona 
mistrust (Conde et al. 2018). 


Mexico did not participate in the IEA Civic Education Study (CIVED) (Torney-Purta et al. 2001), 
but its framework and results shaped subsequent national studies such as Civic Knowledge in 
Mexico: A Comparative International Study (Tirado and Guevara 2006; see also Caso et al. 2008; 
Meléndez 2011). 


A national source of information about the quality and levels of civic knowledge of Mexican 
students has also been the national assessments for civics and ethics education, aligned with the 
national citizenship curriculum. It was not until 2009 and 2016 that Mexico participated in IEA 
studies in this area. The contributions of these two studies will be discussed in the remainder 
of this chapter. 


Civic and Citizenship Education in Mexico 


History and Reforms of Civic and Citizenship Education 


Citizenship education has been an area of formal education almost since Mexico’s birth as an 
independent nation. Most of the training proposals have been a task of education ministries since 
1821 and at present it is the responsibility of the Secretariat of Public Education. Citizenship 
education emerged in the nineteenth century and was aimed primarily at cultivating a sense of 
citizenship with a strong nationalist emphasis (Vazquez 2005; Luna 2014). 


Over the last 100 years, Mexico has experienced important political and social changes that 
have influenced the direction of the country’s educational system and made a direct impact on 
civic education. After Mexico’s revolution in 1910, the idea of a new kind of nation accentuated 
the importance of having a compulsory civic education subject. Changes in the political system 
nd social life also required the inclusion of ethics. 


ied) 


n 1993 two new subjects were introduced to the curriculum: civic education (primary school) 
and civics (secondary school). Both included some topics of international relevance such as 
the promotion of human rights, particularly those of children. As an initiative of the Ministry 
of Education, a significant change in secondary level civic and citizenship education took place 
n 1999 when the subject civics became civics and ethics education (CEE), introducing a cross- 
curricular focus, a more multicultural, cosmopolitan approach rather than a strictly nationalist 
one, and a comprehensive, integral, and constructivist approach (Levinson 2004; Levinson 2007; 
eléndez 2011). The name change also implied that an educational dimension emphasizing 
ethically based decision-making was introduced with applications for adolescents' everyday 
ife. Before this time, ethics had been absent from the curriculum of all the post-revolutionary 
governments because of its association with religion and the government's anticlerical orientation. 


n 2000, the educational authorities of the state of Baja California implemented a new subject 
aimed at promoting a “culture of legality” (i.e., respect for rule of law). In 2009, this subject became 
an elective option in the national curriculum that individual states could adopt: Democratic 
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citizenship education for legal culture building (Levinson 2005; Meléndez 2011). Another 
change took place, in 2006, when the Public Education Secretariat (SEP) proposed a modified 
approach to CEE, organized around the development of civic and ethics competencies. It had 
four key components: a designated subject, a cross-curricular program of activities, a model for 
learning through the school environment, and an emphasis on relevance in students’ daily life. 
These elements prevailed at least until 2011. Stimulated by the election of a new government 
in December 2018, a review of the 2017 curriculum is currently taking place. 


D 


urposes and General Characteristics 


4 


he current citizenship curriculum is mandatory for all public and private schools in the country 
and the latest proposal was published in 2017, and it still includes the specific CEE subject with 
these purposes: 


To strengthen students’ identities to encourage participation and self-development 
2) To exercise freedom and autonomy by employing dignity and human rights as the principal 
criteria in their actions 


3) To promote the development of critical judgment and help the consolidation of civic values, 
based on human rights 


4) To appreciate the ties of belonging that provide identity to social groups, for the promotion 
of solidarity, equity, interculturalism, diversity, and pluralism 

5) To promote a culture of peace by demonstrating ethical sensitivity and civic awareness in 
tuations 


the face of unjust s 


6) Toappreciate their sense of belonging to a democratic State that guarantees justice through 
rules and institutions and respect for human rights 


7) To participate in decisions and actions aiming to change the school, community, and municipa 
setting in favor of the collective well-being and defense of human dignity 


n the first grades of basic education, citizenship topics are integrated across areas; the subject 
CEE itself is taught in grades 4, 5, and 6 of primary school (one hour a week), and in the three 
grades that make up secondary education (two hours per week). 


CEE in Secondary Education 


In secondary education, cross-cutting issues are identified, and CEE shares them with other 
subjects in the curriculum: 


e Native Language (typically Spanish). Social practices of language use for social participation. 

e History. Construction of nation-states, laws, and institutions in Mexico, and processes re- 
lated to globalization. 

e Geography. Public wellbeing according to the Human Development Index (HDI), environ- 
mental problems, and sustainability. 

e Natural Sciences. Health care, ecosystems, and biodiversity. 

e Socio-emotional Education. Abilities oriented toward autonomy, empathy, and collaboration. 


For the teaching of CEE in secondary school, there is an array of textbooks prepared by private 
publishers who follow the contents of the official national curriculum and pedagogical perspective 
formulated by the SEP. Textbooks are the most fundamental resource that teachers utilize (Quiroz 
2000; Sandoval 2000; Landeros 2016). A review of the outcomes found an emphasis on the 
development of the cognitive or knowledge aspects of citizenship. This deemphasizes attitudes 
and abilities related to citizenship. This is in spite of the fact that the students are expected to 
engage in projects to promote inclusion, environmental care, a culture of peace, and attention 
to collective needs, all of which are recognized as part of a holistic citizenship education. 
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Between 2006 and 2014 two large-scale standardized assessments were developed: the 


National Evaluation of Student Achievement (EN 


LACE), and the Tests of 


Educational Quality and 


Achievement (EXCALE). These included a comprehensive assessment for the subject of CEE. In 


2015 the National Plan for the Evaluation of Learning Outcomes (PLAN 


coordinated manner, and it is still being used. 


The Role of the School and Community Context 


EA) was launched in a 


The current curricular approach to CEE encourages the actions aimed at “practical use (of human 


rights and democratic principles), both in situations of daily 


(SEP 2017, p. 440). Teachers are to encourage 


aspects of daily life, as well as promoting work projects for 


life and in relation to social problems: 


democratic deliberation in school to analyze 


as collaboration. The curriculum document urges consideration t 


the school at large are spaces that foster learnin 


This is somewhat different from the meaning of 


of values in various situations of social life. Cr 


schools often includes topics such as human rights, migratio 


The CEE program presents general guidelines to 


the development of civic skills such 
hat both “the classroom and 


g, socialization, and the formation of students” 


(SEP 2017, p. 441). In Mexican Spanish, the term formacion (formation) signifies a broad, holistic 


development of the students’ competencies and dispositions, much like the German term Bildung. 


education in English, which is more limited to 
cognition. Furthermore, the topics designated for cross-curricular treatment deal with the conflict 
oss-curricular or transversal work in Mexican 


or school assembly). The guidelines point out t 


Association. 


Some Debates: Specific Areas of Opportunity 


n, and environmental sustainability. 


encourage the participation of students in the 
school context and daily community life outside the school. However, an important improvement 
would be to include specific references to opportunities for taking part in decisions about school 
life that affect students directly. Some space already exists for this purpose (e.g., wall newspaper 
hat CEE should contribute to a better school 
environment, but there should also be suggestions about activities in participatory bodies that 
already exist in schools such as Student Council, School Council, Community Council, or Parents' 


In a critical analysis of the characteristics of citizenship education, authors such as Bolivar (2007) 
and Scheerens (2011) have raised the need to discuss various ways for this type of education 


to spread throughout the school experience. Likewise, recent analyses of the 2017 Educational 
Model (Chåvez 2019; Conde et al. 2017; Conde et al. 2018) have offered valuable clues to 
identify areas of opportunity for citizenship education. 


These are among the current debates about ci 
curriculum between teachers, policymakers, and 


e How to connect CEE to the real interests an 


parents: 


and those who develop curriculum). 
e How to integrate the interpersonal skills inv 
students in order to enhance socio-emotiona 


d everyday lives of s 


olved in the moral a 


e The loss of emphasis on some civic and ethica 


vic and citizenship education in the Mexican 


tudents (among teachers 


nd political education of 
learning (among curriculum makers). 


competences when 


ricular axes that organize thematic contents” 


among curriculum an 


they became part of “cur- 
d policymakers). 


e The inclusion of areas such as School Climate and Students’ Daily Lives, which used to be 


formative spaces providing opportunities for 
curriculum makers, teachers, etc.). 


participation and so 


idarity at school (among 


Curriculum is an essential device that ensures the systematic implementation of citizenship 
education in México, but for it to function properly and widen its reach and impact, different 
policymaking approaches are needed to work alongside it. These approaches include—but are 
not limited to—the use of important sources of information by decision-makers, such as student 
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learning outcomes on national assessments, Mexico’s results on ICCS, and certainly addressing 
some of the country’s specific needs that are known sources that help build a democratic 
citizenship (e.g., public safety, health and social welfare). In contrast with the past, Mexico’s 
participation on the last two cycles of ICCS has provided an opportunity for the promotion of 
new research studies and evaluations in the field of citizenship. 


Mexican Teachers’ Pre-service and In-service Training in Civic and 
Citizenship Education 


Civic Education Teachers’ Pre-service Training 


The most recent educational reform in Mexico in 2013 was intended to ensure that professiona 
nowledge and aptitude requirements were met by establishing a comprehensive evaluation 
system for entrance into the teaching profession; this was also linked to tenure and promotion 
e.g., to School Principal). However, due to a widespread misperception of the evaluation 
process as being part of labor legislation rather than educational legislation and that it would 
imit educators’ possibilities to hold their current status, teachers protested the reform through 
nationally organized marches, closing of schools, and semi-permanent encampments near or 
outside of official buildings. These were covered in national and international media? (e.g., E 
Universal, El Pais, New York Times, Forbes, BBC News). 


According to the 2013 reform, becoming a teacher also now required meeting a set of criteria 
established by the National Institute for Educational Evaluation (INEE)—an autonomous 
institution—and the General Law for the Professional Teaching Service, which includes the 
guidelines to carry out the evaluation process to access the Professional Teaching Service. The 
evaluation process consists of the administration of two standardized assessment instruments. 
The first test focuses on the assessment of pedagogical abilities and the level of content 
knowledge mastery of the applicant for the particular school subjects. 


4 


he second phase is an examination, which assesses the applicant's level of skills in communication, 
reflection, and potential for improvement of teaching practice. It also explores the applicant’s 
attitudes toward professional practice, school management, community outreach, and legal and 
ethical responsibilities (SEP 2018). To become a secondary school teacher the person must study 
n one of the Federal or State (private or public) Teacher Training Colleges. 


In 2018 a new teacher training program was introduced by the Public Education Secretariat: 
Bachelor's Program for the Teaching and Learning of Ethics and Citizenship Education in Secondary 
School (Diario Oficial de la Federación 2018). It includes subject matter and pedagogical principles, 
while considering emerging social, cultural, economic, and technological issues and changes. 


+ 


Opportunities for Professional Development 


Between 2008 and 2012, civic education teachers could choose to participate in annual courses 
and workshops (SEP 2007). However, this training program was judged to be insufficient in 
helping teachers acquire the skills needed. Some believed that this was because the training was 
mostly content and pedagogy-centered, and it did not have enough opportunity for dialogue 
and the recognition of the diversity of students' needs and of teaching approaches (Chávez 
2009). In 2018, the SEP published the operating rules for the National System of In-Service 
Training, Knowledge Updating, and Professional Advancement for Basic Education Teachers 
that introduced a new subject called socio-emotional education. Currently a new catalogue of 
courses is being considered, which includes topics such as human rights, education for peace, 
peaceful school coexistence, and gender equality. There are 19 Massive Open Online Courses 
(MOOCs), including one for CEE teachers covering some of these areas. 


3 For more information of the published news articles, see Ahmed 2016; BBC News 2013; De Llano 2016; Expansión 
2016; García et al. 2016; Parish 2013; Zabludovsky 2013. 
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Awareness and Use of ICCS in Mexico: Social and Educational 


Perspectives? 
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The Role of ICCS in Shaping the Curriculum? 


Staff members of the Citizenship 


national assessments prov 


international research studies about civic education ( 


2010; Schulz et al. 2018) 
2009 


. The major 


Education Team (CET 


in the Cu 


rriculum Development Division 
are responsible for reviewing new developments and publications as well as the information that 
ide on this topic. This includes key documents derived from national and 


conclusions from these reports were: 


Schulz et al. 2010; Martinez and Gonzålez 


e The average civic knowledge score (452) of Mexican students was significantly lower than 


difference. 


the ICCS international average, which was set to 500 scale points and a standard deviation 


of 100 scale points (Schulz et al. 2018). The majority of students (61%) were at Level 1—the 
owest proficiency level of civic knowledge—or below it, only 10% achieved level 3. The 


score achieved by females was significantly higher than that of males, with a 24 scale point 


e Mexican students support gender equality, equal rights and opportunities for ethnic groups 


2016 


e In general terms, students’ average civic knowledge scores 


in the ICCS 2009 class 
better use of relevant 


increased between 2009 and 2016, with differences rangi 
exico there was a 15 score point increase with reference to the 2009 cycle, 


information 


civic engagement. Gender differe 


showed that female st 
(Conde et al. 2018). 
e An open discussion o 


f political a 


knowledge. Mexican student's per: 
portunities to have open discussio 


along with the ability to a 


ng from 1-4 


in most participati 
12 scale points. In 


and some basic democratic principles, and 40% did understand that media monopolies or 
nepotism among public officials had negative implications for democracy. 


ng countries 


and the per- 


centage of Mexican students at Level A, the highest proficiency level (equivale 
ification), increased 3 percentage poin 


ts; this appears to 
pply knowledge to understand 
nces, although slightly lower (21 scale poin 
udents continued to perform significa 


nt to Level 3 
be related to 


t difference), 


ntly higher than male students 


nd social issues in the classroom is a predictor of civic 
ception of the classroom as a space that offers them op- 
ns showed a significant difference of only one score point 


increase, with respect to 2009 results. This is relevant because it outlines the need for more 


comprehensive research into the 


classrooms. 


The Use of ICCS 2009 Results 


program of 2010, as well 


improvements, such as inc 


framework to identify key concepts i 


as to deve 


type of discussion that is taking place inside of Mexico's 


specified in the CEE program. This w 


luding socia 


evel curriculum. However, in 2011 a 
defining competencies. With this, the 
for program development. 


CCS 2009 has been a reference point for Mexico since 2010. Members of the CET used the 
n order to compare them to the ongoing civic education 
op a new proposal for 2011. The C 
important contents that were assessed by the ICCS cognitive test were absent from the contents 
as discussed and a few actions have been taken to make 
cohesion and legality as specific contents in the secondary 
significant change took place and the new focus was now 
CCS 2009 national report became an important reference 


ET found that some 


4 The authors wish to thank the following academics and researchers for their support in the elaboration of this 
document: Verönica F. Antonio-Andrés, Benilde Garcia-Cabrero, Gonzalo Löpez-Rueda, José A. Sanchez-Gutiérrez, 
Andrés Sandoval-Hernandez, and Martha E. Tortolero-Villasefior. 

5 Information obtained in an interview done with personnel of the General Management of Curriculum Development 
office of the Secretariat of Public Education. 
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The Use of ICCS 2016 Results 


Time constraints prevented the use of the ICCS 2016 framework as input for the development of 
the new program that was going to be launched in 2017. Furthermore, the 2013 constitutional 
reforms changed the structure and responsibilities of the Secretariat of Public Education, which 
implied that it was no longer going to coordinate ICCS; rather, a newly created autonomous 
institution, the National Institute for Educational Evaluation, was appointed as the sole responsible 
organization. With these changes and the moment in which they occurred, use of ICCS 2016 
framework as input for the 2017 curriculum was not possible. 


After the 2017 program for civic education was developed and the ICCS 2016 results were 
published, the CET reviewed the framework. Matching elements were found, such as society and 
civic systems, and democratic values (i.e., equity, freedom, sense of justice, a sense of belonging, 
and civic participation) (SEP 2017). 


A lack of a strong and contextualized official publicity campaign of the results presented an 
opportunity for the press to publish specific descriptive results, which were alarming due to the 
lack of context and meaning. For instance, information on how 43% of Mexican students stated 
that they would participate in illegal acts, such as blocking traffic with the purpose of expressing 
their opinion, was highlighted. When the CET examined the 2016 study results, specifically from 
the questionnaire regarding students’ opinions, they noticed some increase in their interest in 
participating in civic activities. More students were getting involved in school matters through 
the Student Council, and also identifying organizations outside of school with whom they could 
work. That probably reflected beneficial results of the 2011 curriculum which was stimulated 
by civic engagement results from ICCS 2009. The low civic knowledge scores and some trends 
in attitudinal responses were of continuing concern, however. 


Some of the topics that were part of the CCE subject matter program appeared in a different 
curricular position in 2017 (e.g., the topic of emotions under socioemotional education and 
environment under geography). 
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Equal Opportunities and Citizenship Outcomes 


In addition, the Dutch school system is characterized by early educational tracking. After the final 
year of primary school, a selection process determines what secondary school type the student 
will attend: pre-vocational education (vmbo), or one of the levels of general secondary education 
(havo or vwo) that prepare for higher education. The goal of early tracking is to suit instruction 
to the students’ ability levels. However, this characteristic of the Dutch education system leads 
to students being assigned to a specific school type too early in their school career, and limits 
access to higher education (cf. OECD 2016). This reduces educational opportunities, especially for 
students from disadvantaged groups, and increases existing differences in cognitive performance. 


Although the effects of early tracking on general academic achievement have been researched 
extensively, its effects on civic outcomes have not been studied. Do the negative effects of 
tracking also apply to citizenship competences? It could be that the effects are even more negative 
because of the relative homogeneous grouping of students within the tracks, in terms of social 
backgrounds. By this grouping, interaction with diverse individuals, an essential component 
of citizenship in a plural and multicultural society, is limited. The ICCS study conducted in the 

etherlands illuminates the relation between tracking and citizenship outcomes, indicating that 
tracking may promote inequality in civic outcomes. 


Citizenship Competences and Citizenship Education in the Netherlands 


n this section, we focus on the most recent results of the ICCS 2016 study from different angles 
unniksma et al. 2017). First, we will present a general and descriptive picture of citizenship 
nowledge, attitudes, skills, and behaviours of the 14-year-old students involved. Next, to put 
this into perspective, we will compare the results with those from other countries with a focus 
on Belgium (Flanders) and the Scandinavian countries (Denmark, Finland, Norway, and Sweden). 
These countries are comparable to the Netherlands on the Human Development Index (HDI) of 
the United Nations Development Programme. Thereafter, we will look at different periods, by 
comparing the citizenship competences from 2016 to those of seven years earlier (ICCS 2009). 
ext, we will look at differences between schools and between students, including a focus on 
students’ background characteristics and their academic track. Finally, we will examine these 
findings in the light of recent educational policies in the Netherlands. 


Citizenship Competences of Dutch Secondary School Students 


CCS 2016 shows that most Dutch students in the second year of secondary school support 
democratic principles. In general, they trust the institutions of the democratic constitutional 
state. Most students feel that respecting differences of opinion is the most important aspect 
of good citizenship, and most are in favour of equal rights for men and women and, to a lesser 
extent, for ethnic minorities. They have limited confidence in their own citizenship competences 
(such as their ability to follow a debate or defend a point of view). To keep up-to-date with social 
and political issues, most students watch television (63% at least once a week). Newspapers 
and the internet are used much less for this purpose (18% and 10% respectively). In addition, 
71% of students intend to vote when eligible. Their civic knowledge—about the ways in which 
a democratic society “works” the underlying principles and their application—is middling. 


If we compare the Dutch ICCS 2016 findings to those of Flanders, Denmark, Finland, Norway, 
and Sweden, the most important conclusion is that Dutch students clearly have less citizenship 
knowledge than students in these other countries. The group of students with high scores is 
relatively small in the Netherlands, while students with low scores are relatively numerous. 


The results of Dutch secondary school students also lag behind those of their peers in these 
comparable countries in other respects. This includes the importance students attach to 
conventional aspects of citizenship (e.g., voting in elections, learning the history of one’s country) 
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Differences Between Educational Tracks 


Since Dutch schools’ practice early selection of students into different educational tracks, 
comparing these tracks is warranted. Earlier we explained that the Dutch education system is 
characterized by strong external differentiation through separate secondary school types: vmbo 
prevocational education), and havo and vwo/gymnasium. This is reflected in the citizenship results. 
Students in the latter two school types have more citizenship knowledge and think it is more 
ikely that they will vote later in life. They have more trust in societal institutions and are more in 
favour of equal rights for all ethnic groups. In contrast, there are only small differences between 
school types with respect to students’ confidence in their own citizenship competences and civic 
participation. However, the differences in citizenship knowledge between school types are larger 
in 2016 than in 2009 (see Maslowski et al. 2012; Munniksma et al. 2017). The knowledge leve 
of vmbo students in 2016 was about the same as in 2009, while students in the higher schoo 
types scored higher than in 2009. 


Reasons for this relatively large inequality in the Netherlands could be the ways in which 
citizenship education is organized in the various school types or the student grouping into tracks. 
Other quantitative research shows that Dutch schools that prepare their students for higher 
education are convinced that critical citizenship and personal development are important, while 
vocational schools are more focused on adjustment-oriented citizenship and socially acceptable 
behaviour (Ten Dam and Volman 2003; Leenders et al. 2008). With respect to student grouping, 
ongitudinal research in Germany and the United Kingdom shows that placement in different 
educational tracks is related to differences in citizenship outcomes between students in these 
tracks (Eckstein et al. 2012; Janmaat et al. 2014). The Dutch system’s early tracking of students 
appears likely to contribute to the relatively large differences in citizenship competences found 
in the Netherlands. However, data to draw far-reaching conclusions about these differences 
and the underlying mechanisms are currently lacking. 


Citizenship Teaching 


What does the ICCS 2016 study tell us about the state of citizenship teaching in the Netherlands? 
The ICCS 2016 findings show that, compared to schools in other countries, Dutch schools 
invest less in several aspects of citizenship education. Dutch students, unlike their peers in the 
comparison countries, feel that the classroom climate is not especially conducive to discussion. 
They also paint a more negative picture of the relationships between students and teachers than 
their foreign peers (although they have become slightly more positive since 2009). Furthermore, 
a relatively small percentage of Dutch students participate in citizenship activities at school (e.g., 
having a say in how the school is run or standing for or voting in elections for class representatives, 
the school parliament, or the student council). In the Netherlands, students also have fewer 
opportunities to participate in school affairs than their peers in the comparison countries. 


We also see differences in citizenship education between educational tracks. In higher tracks, 
students participate more in democratic activities and feel that this is important. Students in 
higher tracks also report a more open classroom climate for discussion and more positive student 
teacher relations. In contrast, lower track students indicate to have learned more about topics 
related to citizenship at school, than higher track students. The same impression emerges from 
the results of the ICCS 2016 surveys among school managers and teachers. A large majority 
of school managers state that students (like their parents and their teachers) have little or no 
say in school affairs. Compared to other countries, Dutch students also show less interest in 
such participation. Teachers make relatively little use of available teaching aids but mainly use 
textbooks and workbooks. Overall, they indicate that they feel less competent to teach topics 
related to citizenship than their peers in other countries. This is true for topics such as elections, 
the constitution, and international organizations but less so for critical thinking or responsible 
internet use. 
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inform the public debate about whether citizenship education satisfies society’s expectations, 
and where improvement is necessary and feasible. The ICCS 2009 and 2016 studies show that 
the citizenship competences of Dutch secondary school students are less developed than those 
of their peers in neighbouring countries, and there has hardly been any improvement (Kerr et 
al. 2010; Schulz et al. 2010; Maslowski et al. 2012; Munniksma et al. 2017). Moreover, the 
differences among Dutch students are relatively large. Nationally representative samples of 
schools such as those of IEA are essential to address questions related to within and between 
school variance associated with social background. The Netherlands will participate in the next 
ICCS cycle, in 2022, which will allow us to follow these developments over a longer period. 


Meanwhile, the debate about the school’s statutory obligation to teach citizenship continues. In 
the Netherlands, an important element is the issue of the so-far limited steering by the central 
government. Although the law stipulates that schools must pay attention to citizenship, they 
are free to choose the content, approach, and quantity. This freedom in education has led to 
great variation in the way in which citizenship is taught. It also allowed schools to teach in a way 
that is unfocused and ineffective and has led to stagnation in the development of citizenship 
education. Although the position of the Dutch government can partly be understood from its 
reluctance to prescribe particular values to be taught, the traditional importance attached to 
school autonomy plays an even greater role (Glenn and De Groof 2002; Dijkstra and Dronkers 
2003). The result is a mix of factors—the statutory obligation which is defined in very general 
terms and the struggle of school managers and teachers to “give this theme flesh and bones.” 
Until recently, the guiding principle of each school’s autonomy limited many initiatives to develop 
citizenship education. 


This situation makes empirical data on citizenship education and its outcomes especially important. 
The results of ICCS 2009 and ICCS 2016, which show that there has been little improvement 
since the schools were obliged to invest in citizenship education, play an important role in the 
Dutch debate. The disappointing citizenship outcomes combined with existing concerns about 
social cohesion and polarization in society have led to a debate about the need for strengthening 
citizenship education. The findings of the ICCS studies provide documentation of the relatively 
modest outcomes in comparison to those in neighbouring countries and the relatively large 
differences between schools and between academic and vocational tracks. 
T 


he Dutch Education Council, an influential and independent advisory body of the Dutch 
government and parliament, has also taken up the gauntlet. In 2012, the Council advised that 
the government tightens control in the area of citizenship teaching. The Council advised that 
all schools should be offered legal guidelines stating specific expectations concerned with 
teaching students about the democratic constitutional state and how they could function in a 
democratic society (Onderwijsraad 2012). The Inspectorate of Education also advocated that 
schools should be given more guidance and resources for school development (Inspectie van 
het Onderwijs 2016). Finally, citizenship has been given a prominent place in current curriculum 
innovation initiatives for primary and secondary education. How this will be realized and what 
effect this will have on the content and organization of teaching cannot be determined yet. After 
the parliamentary debate, which is still to occur, it will in all likelihood take several years before 
concrete initiatives will reach the schools. 


Nevertheless, some—as yet cautious—government efforts to strengthen citizenship teaching 
have become manifest. One initiative was a “performance agreement” to improve educational 
quality negotiated with the sector organization for secondary education (2014). This has the 
goal of increasing the average citizenship knowledge of Dutch secondary school students by 
2020. Given the, although small, rise in absolute scores on citizenship knowledge, and despite 
growing inequalities, the results were evaluated positively by the Ministry of Education, Culture 
and Science (2017). As mentioned before, the ICCS citizenship knowledge measurement clearly 


played a role in 
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Summary, Conclusions, and Suggestions for Further Research 


The results of the Dutch ICCS study show that most young people support democratic values 
and that their citizenship competences can be considered to be “reasonable” on the whole. 
In absolute figures, the citizenship knowledge of secondary school students is slightly higher 
than it was in 2009. Nevertheless, when compared to other countries, this impression must be 
reassessed: citizenship outcomes are lower than in comparable countries; the differences between 
schools are relatively large and schools pay less attention to citizenship education. Moreover, 
there are relatively large differences between students of parents with different socioeconomic 
backgrounds and between students in vocational and general secondary school tracks. The 
differences in citizenship knowledge between the school tracks have even grown since 2009. 
These results add considerably to the knowledge about the quality of Dutch citizenship education. 
The Inspectorate of Education and the national government advisory body (the Education Council) 
have repeatedly argued that at both school and system level there is little understanding of 
students’ civic outcomes. The ICCS studies are important in this respect. 


Although there are reasons to improve citizenship education, we have shown how complicated 
that process is in the Dutch context. School autonomy as a dominant principle is illustrated, 
for example, by the government’s reluctance to formulate the statutory citizenship obligation 
in specific terms, and limited ambition with respect to improving the outcomes. In addition, 
there is a need to support schools in their efforts to improve citizenship teaching. This has so 
far been implemented in a noncommittal fashion and has been based on the willingness of the 
sector organizations for primary and secondary education to take action. However, a revision 
of the statutory citizenship obligation, which will come into effect in 2021-2022, is being 
prepared. This might address one of the two main obstacles to the development of citizenship 
education (more clarity for schools on what is expected of them) but not the other (the lack of a 

n 

e 

e 


5 


+ 


supportive infrastructure for schools). Remarkably, the intended national curriculum revision, i 
which strengthening the societal task of schools is a major consideration, appears not to hav 
had a stimulating effect. In keeping with the Dutch tradition, the education field, where th 
influence of both educational organizations and teachers is strong, has assumed an important 
role in this process. There are few safeguards for quality assurance or governmental steering in 


terms of content. 


Further research, including international comparative studies such as ICCS, could make an 
important contribution to the future development of citizenship teaching and citizenship results. 
A positive factor is the decision of the Ministry of Education, Culture and Science to participate 
in the ICCS 2022 cycle and also to organize a supplementary national study (in 2020). This new 
information, to be based on ICCS instruments, will not only contribute to our knowledge of the 
current situation that can be used as policy inputs, but could also lead to a better understanding 
of the relation between characteristics of citizenship education and its outcomes. This could lead 
to better insight into “what works.” It may be worthwhile to assign this a more prominent place in 
future ICCS research. For example, it may be valuable to investigate how specific characteristics 
of citizenship education are related to outcomes and to think about ways to give the ICCS design 
a closer fit with what nations need to know in order to develop effective national educational 
policies. Of course, international comparisons would be retained. 


The question of what the school’s contribution might be leads to an important issue. It seems 
evident that not only the schools, but parental resources, peers, and media have a substantial 
effect on citizenship competences. This should reduce expectations that only investments in 
education are required to promote citizenship competences. The fact that the influence of 


schools appears to have been modest shows that it is important to provide adequate steering 
about where schools can make their influence felt. In this respect, an important role is played 
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CHAPTER 13: 


Strengthening Connections Between Research, 
Policy, and Practice in Norwegian Civic and 
Citizenship Education 


Heidi Biseth, Idunn Seland, and Lihong Huang 


Abstract In this chapter, we introduce recent education reforms in civic and citizenship education 
in Norway. We conducted an extensive literature review of relevant Norwegian published 
studies since 2000, providing a broad overview of the variety of studies undertaken with the 
aim to strengthen the connections between research, policy, and practice in this field. This 
investigation of IEA's International Civic and Citizenship Education Study (ICCS) in the Norwegian 
policy documents, confirms the impression of civic and citizenship education studies having a 
substantial influence on the educational agenda in Norway. 


Introduction 


The Norwegian education system is designed to promote democracy together with values 
such as equality, solidarity, and human rights. Students are expected to share responsibilities 
for decisions and have the right to participate according to the Norwegian Education Act 
Kunnskapsdepartementet 1998). In this chapter, we discuss Norwegian civic and citizenship 
education including the most recent reforms. Then we describe how Norwegian teachers are 
prepared to teach civic and citizenship education. As we did not find any summary of Norwegian 
publications on civic and citizenship education, we conducted a review from 2000. The chapter 
also describes how International Association for the Evaluation of Educational Achievement 
IEA) International Civic and Citizenship Education Studies (ICCS) are presented in education 
discourse and appear to be influencing Norwegian policy. 


eidi Biseth was a member of the National Advisory Group for the ICCS 2016 in Norway, she 
also conducts research using IEA’s Civic Education Study (CIVED) and ICCS data. Lihong Huang 
was the national research coordinator for ICCS 2016, and senior researcher Idunn Seland was 
an NRC research team member. 


Current Civic and Citizenship Education 


The last reform in Norwegian education took place in 2006, so the ICCS 2009 partially 
captures some of these alterations. The aim of the reform was to increase the achievements 
among all students as described by the Norwegian Ministry of Education and Research 
(Kunnskapsdepartementet 2020). Basic skills; orality, reading, writing, arithmetic, and digital 
skills, were introduced in all subjects and across all grades. Learning outcome-based education 
was introduced in addition to an increased local autonomy on how to organize the education. 
Two compulsory subjects are crucial in civic and citizenship education: 


e Social studies (634 hours in total in grade 1-10, 168 hours in senior high school) 
e Christianity, religion, philosophies of life, and ethics (580 hours in total in grade 1-10). 
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Teachers of Civic and Citizenship Education 

In the contemporary Norwegian education system, certain subjects play a key role in civic and 
citizenship education. Teachers of social studies and Christianity, religion, philosophies of life and 
ethics, as well as all qualified teachers of junior high schools, are capable of teaching the content 
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rights, as part of how we live together in a democracy, this was not visible in how they designed 
their teaching and learning activities. 


These results on student teachers align with another publication in the Democracy in everyday 
life study focusing on about 150 teacher educators’ understandings and descriptions of their 
practices related to democracy and democratic education (Biseth and Lyden 2018). The 
overwhelming majority of respondents reported encouraging student teachers to take part 
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in formal participatory structures at the university level such as Students’ Council; this meant 
promoting democratic engagement through formal political structures. Additionally, discussion 
was the predominant classroom activity used by teacher educators to prepare future teachers 
for democratic actions. The authors argue that several teacher educators in this study displayed 
an understanding of democracy that was more advanced than the weak understanding found in 
previous studies. However, it seemed as if teachers’ understanding did not translate into their 


earning and teaching activities. For example, 95% of the respondents assess soc 
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a core element of democracy, yet practices related to social justice was often considered to be 
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enrollment in vocational or academic tracks. When the impact depends on individual teachers, 
development of civic competence can be vulnerable within the school system. 


Embedded in the Norwegian Education Act (§ 11-2) is the belief that student councils are both 
a democratic hallmark of Norwegian education and a way of engaging Norwegian students in 
democratic political activities. The Act explicitly commits schools to democratic ways of planning, 
teaching, and organizing their activities. Borhaug (2007a, 2007b) investigated political education 
and asked the provocative question, “Are Norwegian student councils democratic?” (2007a, p. 
27). In his empirical study of five junior high schools, he argues for two criteria to answer these 
questions: 1) student councils feeling free to engage in considering a broad range of issues they 
themselves see as important, and 2) student councils having an actual power base, not only the 
ability to simulate engagement in an imitation of democracy. Børhaug found that neither of these 
criteria were fulfilled, and what is labelled as democracy by the school does not really qualify 
as democratic activity. Biseth (2012) argues in the same vein, based on a study of democracy 
in multicultural school environments, claiming that students are socialized through what only 
appears to be a formal democracy. The students, rather, learn that their ability to act is strictly 
imited, their engagement unlikely to prove fruitful, and their achievements relate to minor 
issues allowed by the headmaster (usually related to social activities at school). One might ask 
whether the ambition of achieving democratic education through student councils accomplishes 
the intended aim in practice. 


ied) 


Furthermore, Solhaug and Osler (2018) argue that intercultural empathy constitutes a 
characteristic of an inclusively oriented citizen; they examined how 1,006 students across 
junior and senior high schools display this civic characteristic. There were substantial differences 
between boys’ and girls’ intercultural empathy (echoing a finding across the IEA civic education 
studies). Intercultural empathy was measured using expression of empathy, empathetic awareness, 
acceptance of cultural difference, and empathetic perspective taking. Students’ understanding 
of cultural diversity predicted intercultural empathy. The school variables explored in this study 
to identify ways to support students’ intercultural empathy showed limited associations with 
intercultural empathy outcomes. Yet, the authors suggest school practices supporting inclusive 
citizenship that promotes open dialogue and discussions. A comparative study conducted by 
Huang and Biseth (2016) concluded differently. Using Scandinavian student data from ICCS 
2009 on the measures of open classroom climate (seven items that ask students how often 
they experience each of these seven teaching practices during regular lessons), the authors 
investigated how each practice contributed to increased students’ civic knowledge achievement. 
Only students with high civic knowledge achievement were included in the analysis. The authors 
compared the strength of each of the classroom practices for its correlation with civic knowledge 
achievement by applying logistic regression (i.e., estimating the effect of each of these classroom 
practices on the probability of students becoming high achievers of civic knowledge). Practices 
such as “Teachers encourage students to make up their own minds” and “Students bring up 
current events” seem to increase the odds of high achievement of civic knowledge. The classroom 
practice where “Teachers encourage students to discuss the issue with people having different 
opinions,’ however, is the one teaching practice that appears to decrease students’ odds of 
becoming high achievers in this Norwegian sample. 


Several national studies on civic and citizenship education make suggestions on integrating these 
topics into several school subjects. Mathé (2016) focusing on social studies, investigated 16-year- 
old students’ understanding of the concept of democracy (N=23). Students primarily expressed 
a liberal understanding of democracy, focusing on voting in elections as the main characteristic. 
Mathé argues that teacher educators in social studies should engage actively in discussing 
and defining core concepts with their student teachers and develop further opportunities for 
understanding modes of democratic participation. 
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knowledge and teaching methods, their sense of preparedness in teaching practice of civic and 
citizenship education. They investigated how these variables were associated with students’ 
experience of classroom climate. Eriksen and Huang (2019) did a comparative analysis of ICCS 
2016 data from Denmark, Finland, Norway, and Sweden examining the association between 
the school administration’s awareness of bullying among their pupils, student reports of bullying, 
and the measures in place at schools in each country. Cheah and Huang (2019) investigate how 
practices undertaken to implement environmental citizenship education in Nordic schools are 
associated with the behaviors and attitudes of students and their future intensions to address 
environmental issues. 


These numerous academic publications provide evidence of substantial interest in the ICCS 
studies among Norwegian educational researchers. In addition, Norwegian researchers are 
preoccupied with a range of themes within civic and citizenship education, particularly on how 
this plays out in the education sector, ranging from policy level, through teacher education 
to implementation in schools and classrooms. The studies not based on the ICCS studies 
complement and nuance the picture by going into more details on other aspects than ICCS. 
However, despite the well-established democracy in Norway, an almost unison voice is raised 
among the researchers stressing the need of even further growth and development in civic and 
citizenship education throughout all education levels and across subjects. 


Presence of ICCS Studies in Education Discourse, and their Influences 
in Norway 


In this section, we examine policy documents at the state level between 1999 and 2019 to 
determine whether, and how, the IEA’s civic and citizenship studies have impacted policy 
formation for primary schools, high schools, and teacher education in Norway during this period. 
The document search was conducted through the website of the Norwegian parliament, www. 
stortinget.no, and complemented by a search for public reports in the series Norges offentlige 
utredninger (NOU) via the website of the Norwegian Ministry of Education and Research. NOUs 
are research, policy, and legal reviews prepared by public committees for subsequent government 
white papers or bills. We searched the websites for the abbreviations “CIVED’/"CIVIC”? and 
“ICCS,’ which resulted in a sample of 22 documents, including parliamentary committee reports 
and minutes from parliamentary debates. We then searched the parliament’s website for the 
keyword “demokrati” (democracy), specified to documents tagged with the keyword “undervisning” 
(education), resulting in a sample of seven documents not included in the first search. 


The majority of these 29 documents were either written by or commissioned for the Norwegian 
inistry of Education and Research (Kunnskapsdepartementet), or by the parliamentary 
committee responsible for education i.e., the committee for Church, Education and Research 
kirke-, undervisnings- og forskingskomiteen). However, our search also yielded two government 
white papers referencing the CIVED/ICCS studies written by the Ministry of Finance 
Finansdepartementet) and the Ministry of Trade and Fisheries (Nærings- og fiskeridepartementet), 
respectively, and one NOU written to the Ministry of Children and Equality. The first white 
paper points to the decreasing social gap in Norwegian students’ democratic knowledge as 
demonstrated in the ICCS 2016 (Finansdepartementet 2019). The second white paper briefly 
comments on how results from the ICCS 2009 were made relevant to the Nordic Council of 
Ministers during Norway’s presidency, resulting in a Nordic teacher educators’ conference 
on democratic values (Nærings- og fiskeridepartementet 2013). In NOU 2008: 6 (Barne- og 
familiedepartementet 2008), a public committee refers to Norwegian students’ attitudes towards 
gender equality measured in the CIVED study from 1999. In all, we found references to four 


2 Our document search showed that IEA CIVED in 1999 has frequently been abbreviated “CIVIC” at Norwegian state 
level. 


154 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 
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Norway about how learning outcomes and competences should be measured by standardized 
tests (Mikkelsen and Fjeldstad 2013). 


We see in the documents how a combination of “democracy” understood as Bildung and 
references to the impact of the CIVED/ICCS studies on Norwegian policy formation become 
more evident after ICCS 2009. The first example is a white paper on junior high school 
Kunnskapsdepartementet 2011) concerning a minor curriculum revision of 2013 affecting 
student councils (also see Kunnskapsdepartementet 2013). In the latter document, committee 
members use benchmarks from ICCS to back their more normative Bildung-based deliberations 
on the general value of school as the main site for democratic learning. These two different 
conceptual strands of “democracy” in Norwegian policy documents for education seem to merge in 
the national curriculum reform, to be implemented from August 2020 (Kunnskapsdepartementet 
2015). This curriculum reform prescribes democracy and citizenship as one of three crosscutting 
themes in education, jointly with public health and life skills and sustainable development. First, 
this implies that democracy and citizenship are considered core values of Norwegian education. 
Second, the new curriculum mentions developing democratic competence as an aim for students. 
The education system is expected also to ensure a school environment in which students have 
experiences with what active participation in a democratic community entail. Additionally, 
educators are expected to foster citizens who can contribute to further developing democracy, 
making it more robust and sustainable. In other words, it is no longer sufficient to socialize students 
into the current democratic system; they have to become agents for improving democracy (cf. 
Biesta 2011; Westheimer 2015). 


What we see in policy documents from the 20 years that have passed since Norway joined the 
CIVED study in 1999 is that the idea of democracy and civic and citizenship education fall into 
two distinctive categories, which could be said to evolve as two strands. The first strand utilizes 
the IEA studies as benchmarks for educational quality, whereas the other strand continues the 
understanding of democracy as a core educational value that cannot be fully measured through 
standardized tests. After ICCS 2009, we detect in the documents an alignment of these two 
conceptualizations: new educational efforts for civic and citizenship education refer to both the 
EA studies and to democratic Bildung, combining these as competence aims for democratic 
earning. 


Conclusion 


It is evident that the ICCS studies have begun to have an impact at the education policy level in 
Norway, although they have sparked little public debate and yet have had little direct influence 
on teacher education and school practices. We observe connections between nationally based 
research on democratic citizenship and international studies such as the ICCS, specifically 
those targeting the fields of teacher education and school practices. We regard these trends as 
welcome parts of a national effort to strengthen the connections between policy, research, and 
practices in the education system to encourage the development of active democratic citizens. 
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CHAPTER 14: 


The Role of IEA’s Civic and Citizenship Education 
Studies in the Development of Civic and 
Citizenship Education in Slovenia 


Eva Klemencic Mirazchiyski 


Abstract The changes in civic and citizenship education in the period from the 1980s t 
2019 in Slovenia exemplify the process of socialism’s social and moral education evolution 
It was characterized by transitions in ethics and society, as well as in citizenship education 
and a renewed focus on patriotism. At the same time this is the period when the IEA’s CIVED 
(Civic Education Study) and ICCS (International Civic and Citizenship Education Study) were 
conceptualized and conducted globally. Therefore, we have tried to identify the “impacts” of 
CIVED/ICCS on Slovenian policymaking in education. This is seen especially in the development 
of the compulsory subject in the Slovenian grade 7 and 8. Those “impacts” are direct in some 
respects, but it is also important that indirect impacts can be identified. We conclude with recent 
discussions about civic and citizenship education in Slovenia, and the role of ICCS in them. 


O 


Introduction 


Slovenia gained its independence from The Socialist Federal Republic of Yugoslavia in June 1991. 
As stated in the White Paper on Education in the Republic of Slovenia from 1995: 


“Far-reaching changes in Slovenia—especially the formation of the independent state, the 
implementation of a multi-party system and the adoption of the new constitution—mean that the 
education system should also be changed, in particular regarding the introduction of a European 
dimension. This process should be based on the common European heritage of political, cultural 
and moral values reflected in human rights, the rule of law, pluralistic democracy, tolerance, and 
olidarity” (Krek 1996, front page). 


Ww 


n 2011 the new White Paper on Education in the Republic of Slovenia (Krek and Metljak 
2011) was published, containing an explicit reference to the International Association for the 
Evaluation of Educational Achievement (IEA) CIVED 1999 (Civic Education Study) and ICCS 
2009 (International Civic and Citizenship Education Study) results. All the international large- 
scale student assessments (ILSAs) that Slovenia participated in (including all IEA’ comparative 
studies and their cycles, and OECD PISA!) were mentioned in this document. 


In this chapter we first focus on how the educational system (and consequently citizenship 
education) changed from the 1980s onwards. Within federal Yugoslavia, the six republics had 
autonomous educational systems on every educational level, therefore the breakup of Yugoslavia 
in the early 1990s had only a minor impact on the functioning of schools (and universities, which 
had an even more autonomous status). However, there were obvious shifts in social science 
curricula and “Yugoslavian topics” fell almost completely out of focus. National perspectives 
about subjects such as history had primacy over the federal aspect (Justin et al. 2013).? Due to 
autonomy of the republics there were no limitations on putting national history including ethnic 
Slovenia in a prominent place in Slovenian curriculum or syllabi. Specific facts from history that 


1 OECD = Organisation for Economic Co-operation and Development; PISA = Programme for International Student 
Assessment. 

2 The historical overview of the development of civic and citizenship education in Slovenia is a part of monograph 
in Japanese language, which was prepared after a historian from Japan came to Slovenia to be informed about the 
development of history education and in this regard with the addition of civic and citizenship education. After the meeting 
held at Educational Research Institute, we were asked to prepare a text that in 2013 was published. In this chapter this 
refers to the publication Justin et al. (2013). 
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led in the formation of Slovenian statehood were included (D. Štrajn, personal communication, 
August 8, 2019). There was a request to abolish the subject social and moral education. However, 
a group of researchers from Educational Research Institute (later responsible for CIVED/ICCS 
national coordination) and from National Education Institute Slovenia (responsible for syllabi for 
compulsory education) made efforts to ensure that the social science curriculum included civ 
and citizenship education (CCE) (D. Štrajn, personal communication, August 8, 2019). We ca 
say that the changes brought about by political independence were relatively gradual in movin 
u C 


c 
n 
g 
toward citizenship education suitable for an independent Slovenia. In fact, Slovenia participated 
g 
d 


in all cycles of the CIVED/ICCS study. Moreover, those coordinating CIVED or/and ICCS or usin 
those datasets, have been actively involved in curricular reforms, in writing/editing syllabi an 
textbooks for compulsory subjects on CCE, in university lecturing, and in designing workshops 
for teachers. One researcher was even involved in the preparation of two coalition agreements 
between political parties that formed a government. This justifies our belief that CIVED/ICCS 
has had an impact on the development of CCE in Slovenia; the challenge is to define the nature 
of both the direct and indirect “impact.” First, however, we examine the historical development 
of CCE in Slovenia focusing on the primary education level (compulsory nine years of schooling, 
referred to as the elementary education level) with a special focus on grade 7 and 8 students 
(grade 8 students being the CIVED/ICCS target population). 


A Short Description of the Changes in Citizenship Education in Slovenia 


“Citizenship Education” in Socialistic Slovenia 


Citizenship education within a socialist state is a contradiction, as the one crucial socialist or 
communist idea is the abolition of the state itself Justin et al. 2013). Class awareness is the crucia 
concept not citizenship, and the goal is not to build a socialist state but to build a communist 
society (Justin et al. 2013). It is no surprise that in socialist Slovenia, the subject that stood in 
place of citizenship education was social and moral education (Justin et al. 2013). It focused on 
society not the state. This is confirmed by reading the Slovenian primary school curriculum from 
1983 (Ministry of Education, Science and Sport 1983). Words such as society, social community, 
country, land, or homeland, sometimes nationality were mentioned, but never the state; even 
foreign states were named lands or nations. The subject was covered in the final two grades (7 
and 8) of elementary school in Slovenia, time allocated to the subject was one hour per week. 
Social and moral education included elements of political education in line with socialist ideology. 
However, it included broader topics such as psychological, religious, and economic aspects along 
with human values in a self-governing socialist society. It was more like a general social science 
and humanities subject than it was like political or citizenship education; only 25 periods out of 
68 were dedicated to the domain of citizenship education (Justin et al. 2013). 


The pupils received no numerical grades in social and moral education, which could indicate 
that the subject did not have the importance that one would expect from the contents of 
its curriculum. That includes especially the teaching of a socialist self-governing system and 
socialist morality as the ideological base of society. Assigning no grades could indicate that the 
transmission of values was more important than the transition of measurable knowledge. This 
diminished focus on political education in the curriculum itself was even more de-emphasized 
in educational practice (Justin et al. 2013). One reason certain topics in teaching social and 
moral education were avoided was political. At the end of 1980s socialism was in decline and 
democratization was in full swing therefore teachers simply stopped teaching the topics “that 
went out of currency and that were actually never a reality” (Zupancié 1990, p. 55). 
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Citizenship Education in Independent Slovenia 


The gaining of the independence of Slovenia (1991) and the change from a socialist to a liberal 
democratic political system (through the first multi-party elections in 1990) brought reforms to 
the educational system. Elementary education was prolonged for one year (from 8 to 9 grades), 
teachers’ autonomy gained importance, and curricular planning changed. A transition to a new 
education curriculum, more open (not only with strictly prescribed content) and goal oriented, 
was completed by 1999 (Justin et al. 2013). More importantly “education for and participation 
in democratic processes” was one of the eight basic principles of educational reform stated in 
the White paper (Krek 1996, pp. 47-48). An essential premise for participation in democracies 
is the development of a critical spirit, personal decision-making, and autonomous judgment (Krek 
1996). These are processes where schools play an important role by developing capacities that 
allow individuals to participate in democratic processes (Krek 1996). 


Before describing the new compulsory subject of CCE, it is important to mention that the 
reform introduced optional subjects in grades 7, 8, and 9. One was citizenship culture, taught 
in grade 9 (32 hours per a year), which deepened and expanded knowledge and skills found in 
the compulsory subjects. However, citizenship culture has not often been chosen by students. 
Other optional subjects are religion and ethics, philosophy for kids, media education, etc. All 
these subjects are now numerically graded. 


nthe first half of the 1990s, social and moral education was replaced with ethics and society—the 
new name implying both change and continuity (Justin et al. 2013). Changes in course content 
were made too. Marxism that was underlying previous social and moral education was replaced 
with pluralist psychological and sociological theories Justin et al. 2013). There were also content 
changes. Instead of the socialist political system, basic principles and institutions of libera 
democracy are taught; the notion of state becomes central with citizenship becoming a crucia 
political identity; human rights become one of the central topics (Justin et al. 2013). However, 
the principles of curriculum formation remain the same. Ethics and society retains the status of 
a general social sciences subject one hour per week. In August 1991, an experimental manua 
for pupils for the ethics and society subject was published (for grade 7 and 8) (Bezenšek et al. 
1991). The chapters for example were: humans and their status in the biggest religions of the 
world; humanism; change of work and free time; cooperation and solidarity, humans and their 
conscience; principle of tolerance; new quality of life, etc. This illustrates thematic breadth that 
goes beyond political or citizenship education. In 1990s the question of who could teach the 
CCE subject was on the agenda too, the decision was that teachers who had the social sciences 
foundation. In practice this means teachers of the previous subject, social and moral education 
(D. Strajn, personal communication, August 8, 2019). 


The reformed curriculum of 1999 also introduced a subject named citizenship education and 
ethics with almost the same number of periods/hours (70 in two years) as the subject it replaced 
(ethics and society) Justin et al. 2013). This subject was compulsory in grade 7 and 8, education 
was once again vzgoja in Slovenian (which could be translated as “upbringing”). Several elements 
of the subject social and moral education remained. Psychological topics on family, problems of 
puberty and adolescence, and career planning all remained, along with sociology of small groups 
and generational conflicts. Globalization remained a part of the subject as well as teaching about 
religion. More weight was put on the topic of public debate, and the role of public (mass) media 
gained importance (Justin et al. 2013). However, only one of the five compulsory topics in grade 
7 was specifically civics—one that focused on basic understanding of community, nation, and state 
with an emphasis on the Slovenian nation getting independence and provided information on the 
unification of Europe. The latter was not intended to cover the main parts of the political system 
(Justin et al. 2013). That remained for grade 8 in the form of a compulsory topic, management 
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are used in elementary (compulsory) education for the area of citizenship education and also 
in the ICCS target grade. It can be a separate subject. It can also be integrated into broader 
compulsory subjects or learning areas such as history, geography, and Slovene language. Or it 
may be a cross-curricular objective to be delivered by all teachers (Eurydice 2017, p. 11). Such 
approaches to CCE can be seen also at the upper secondary level. 


Slovenian Participation in CIVED/ICCS and Some Results 


CCE after the collapse of communism put considerable emphasis on democratic values and 
new rules of social behavior as well as changes in the public’s sense of identity (Strajn 1999, p. 
546). It is also important to remember that the content covered within the curriculum starting 
as early as 1983 and even more in 1990s began to show those shifts in focuses. Therefore, 
it is no surprise that Slovenia was interested to join both phases of CIVED 1999. Due to later 
structural changes at the national, regional, and international levels, Slovenia continued its 
interest in being part of ICCS. 


Before Slovenia joined the CIVED 1999 study, the implementation of the curriculum from 
1983 (the syllabus for social and moral education) was monitored by studies performed at the 
Educational Research Institute (which also served later as the national research centre of CIVED/ 
CCS). In the early 1990s, Slovenia started participation in IEA studies. In CIVED 1999 (with 
two populations; a main target population, which were grade 8, as well as with grade 12—upper 
secondary level). Slovenia also participated in ICCS 2009, this time with the target population 
grade 8), and also added an additional population of grade 9 students (to assess our reform). 
We participated as well in ICCS 2016 and are preparing for participation in ICCS 2022. 


Results in CIVED 1999 revealed that pupils in Slovenia were slightly above the international 
average in civic knowledge; below average results were found in attitudes toward immigrants, 
trust in institutions related to authority, and in the open school climate for discussion (Simenc 
2011, p. 139; Torney-Purta et al. 2001). In particular, attitudes towards the rights of immigrants 
were less positive compared to other countries participating in the study with the exception only 
f Germany (Simenc 2011, p. 139). This was true both for the grade 8 students in Slovenia and 
also for students four year older at the upper secondary level (Simenc 2011). 


O 


From ICCS 2009, the most interesting results in the CCE area were those showing changes 
n the critical areas compared to CIVED 1999 (Šimenc 2011, p. 140). The results in areas of 
concern that emerged in the 1999 CIVED study were all improved—the proportion of pupils in 
Slovenia with positive attitudes towards rights of immigrants was more similar to the proportion of 
pupils in other countries; the confidence of Slovenian pupils in institutions related to authorities 
was slightly lower than the international average but significantly higher than in 1999; pupils 
perceptions of the openness of discussions in the classroom were similar to the international 
average (Šimenc 2011). It must be remembered, of course, that the set of countries being 
compared differed between the two test administrations. However, when comparing trends 
among countries participating in two consecutive data collection, Slovenia was the only country 
in ICCS 2009 where statistically significant progress was made in civic knowledge in comparison 
to the prior data collection (Schulz et al. 2010, p. 83).* In the cognitive (knowledge) part of the 
European regional module, which was included in ICCS 2009, Slovenia ranked in some items 
bove and in others below the European average (Kerr et al. 2010, pp. 52-56). 


ied) 


Proficiency levels in civic knowledge also shows interesting trends. In the 2009 cycle 
approximately 9% of pupils in Slovenia were below level 1 (the lowest proficiency level), which 
means achieved less than 395 score points, and majority of pupils achieved scores that placed 


3 Although pupils from Finland and Estonia made progress in civic knowledge, the difference was not statistically 
significant. 
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them within proficiency level 2. To be more precise, approximately 36% of pupils were at this 
evel and approximately 30% at the highest level, level 3 (Schulz et al. 2010, p. 79). In 2016 
approximately 4% of pupils achieved level D (which was previously named level 1) or below level 
D, and the proportion of students at levels A (the highest level) and B was approximately the 
same (37% and 38%) (Schulz et al. 2018, p. 60). This difference between 4% and 9% of students 
at the lowest proficiency level is statistically significant, which means that in 2016 Slovenia had 
ess low achievers in civic knowledge than in 2009. 


We looked at the content match between two syllabi (one from 1999 and another from 2011) 
with tasks/items included in the ICCS 2009 (Klemenčič and Stremfel 2011, pp. 114-115). The 
purpose was to gain insight into how our syllabus for the compulsory CCE course matches 
topics of ICCS (p. 115). In particular, when comparing percentages of correct and incorrect 
item responses in ICCS 2009 Slovenian students showed good performance on knowledge 
regarding human rights and responsibilities of authorities and the government. Content analysis 
also showed that there is good coverage of topics (in both syllabi corresponding to the ICCS 
2009 cognitive test). However, the syllabus from 2011 had better coverage than the syllabus 
from 1999 (Klemenčič and Stremfel 2011). The results of ICCS 2016 for Slovenia shows not 
only trends between two cycles, but also the “success/efficiency” of the new syllabus that was 
introduced after ICCS 2009. Trends are positive in terms of civic knowledge (Schulz et al. 2018, 
p. 62). Perception of open discussion in the classroom is still below the international average, 
and there was no statistically significant change from the 2009 cycle (p. 88). 


The European regional module in 2009 tested European specific civic knowledge, attitudes, and 
engagements in European countries. In 2016 the module slightly changed—knowledge was not 
tested. Slovenia introduced EU/European related topics and made other changes in the syllabus 
for 2011. We cannot say that the only reason for adding EU topics to our syllabus was ICCS 
2009. However, we can say that those topics appeared in the syllabus after ICCS was conducted 
and that the leader of the group revising the CCE syllabus and some other researchers included 
in this group were well aware of the topics being tested in ICCS. The results from the 2016 
cycle show that the Slovenian national average for pupils’ sense of European identity and pupils’ 
endorsement of equal rights for immigrants are above the average of participating European 
educational systems. In 2016, however, the change was not statistically significant according 
to Losito et al. (2018, p. 11, 28). 


In 2019 there were elections for the European parliament. The national percentages of pupils 
who reported that they would certainly or probably vote in elections changed significantly in 
Slovenia (between the two cycles). More pupils in 2016 expressed a high probability that they 
would participate in local and European elections (when they will have voting rights) (Losito et 
al. 2018, p. 45). However, the percentage of pupils expecting to vote in the European elections 
were the lowest in Estonia and Slovenia in comparison to other European countries (p. 44). This 
means that although percentages for pupils in Slovenia expressing expectation to vote in the 
European elections increased, they are still low. 


The results of Slovenia’s teacher's questionnaire are relevant. More than half of teachers reported 
that they did not have the opportunity to learn about voting and elections, neither during 
their in-service teacher training, nor in their continuous-professional development. About 40% 
reported that they did not have the opportunity to learn about the EU (Klemenčič et al. 2019, 
p. 54). Confidence in teaching about voting and elections and the EU was consequently low 
p. 55). So, are our teachers satisfied with the existing syllabus after these many changes? The 
results of ICCS 2016 show that a relatively small percentage, a little over 10%, said that a new 
syllabus for the compulsory subject of patriotic and citizenship culture and ethics is needed, and 
that this was not the most needed improvement in the CCE (p. 114). 


THE ROLE OF IEA'S CIVIC AND CITIZENSHIP EDUCATION STUDIES IN SLOVENIA 167 


t's too early to talk about the “impact” of the 2016 cycle, but the study certainly has a great 
deal of data that can be used for understanding and designing both policies and practices. First, 
the “impacts” of ILSAs and CIVED/ICCS in particular should be discussed in terms of policy. 


“u 


Impact” of CIVED/ICCS on Educational Policymaking in Slovenia 


tis challenging to distinguish direct from indirect impacts of ILSAs. Wagemaker (2013) provided a 
useful warning that different international organizations and different ILSAs, although they “share 
a common focus of measuring achievement outcomes, differ in their objectives and design ... 
with) significant implications for how they might potentially influence educational policy ... and 
research community” (p. 13). The following measures of impact have been suggested: growth in 
LSA participation and ILSA-related discourse as a measures of impact, changes in educational 
policy, curriculum, teaching, capacity building, and research endeavours, and global and donor 
responses as a measures of impact (pp. 16-32). In Slovenia we have traced those impacts, but the 
challenge is how to interpret the evidence. We do not have evidence to distinguish between the 
direct and indirect “impacts” of CIVED/ICCS on the development of CCE in Slovenia. However, 
we can show that preparing textbooks, training for teachers, and revised curriculum/syllabus 
design undertaken in the light of the results have been influential. 


In 2010, the author of this chapter conducted a two stage qualitative study to investigate the 
“impacts” of ILSAs on national policymaking in education, including CIVED/ICCS. In the first 
phase, structured interviews with questions sent via emails were used, and in the second stage 
semi-structured face-to-face interviews. Respondents were national research coordinators, expert 
and advisory board members, and policymakers (including one former minister who had been 
responsible for education). The results showed that the impacts depend on the study’s topic; they 
are different on different levels; they are especially visible after recent curricular reform; they are 
more systematic then at the beginning of Slovenian’ participation in ILSAs (Klemenčič 2010, p. 
254). The most clear-cut answers were for the question about why Slovenia is participating in 
those studies—the reason was the need for evidence-based policy and additional data especially 
for secondary analysis. Respondents were also quite similar in beliefs about which studies have 
the most media and expert interest in their results, “TIMSS and PISA seem to be of interest in 
the media, however ICCS is probably more important for experts dealing with (the subject matter 
of) citizenship education” (pp. 254-255). This is consistent with a conclusion of Pizmony-Levy 
and Torney-Purta (2018), who envision the impact of ICCS studies taking place through the 
establishment of a community of practice among researchers and educators. Slovenia appears 
to be developing such a community. 


The periods in which CIVED 1999 and ICCS 2009 were conducted in Slovenia, when the results 
were published and when some national secondary analysis were done, and the revisions of 
syllabus for CCE, were the same. We will try to examine the “impact” of the two mentioned 
cycles of the IEA study on CCE taking into consideration some challenges. As we mentioned in 
the introduction, in 2011 the new White Paper on Education in the Republic of Slovenia was 
published, this time with an explicit citation and reference to the CIVED 1999 and ICCS 2009 
results—specifically rankings on civic knowledge (Krek and Metljak 2011, p. 111). 


) 


At first glance it seems that CIVED in Slovenia had a relatively small “impact” on national 
policymaking. However, results expressed a very high inclination toward everything that is 
connected with national identity and patria. Slovenia changed the name of the compulsory 
subject in 2008 (adding patriotic) (Klemenčič 2010; Šimenc 2011). However, it appears that ICCS 
2009 seems to have had a slightly bigger “impact. Even if the name of the subject remained the 
same, expert arguments (from both CIVED 1999 and ICCS 2009) have had the opportunity to 
influence the development of a new syllabus (Simenc 2011, p. 140). 


It appears that patriotism remains a contested terrain including the question as to whether it 
should be more fully covered in the curriculum. In the beginning of 2019, a parliamentary member 
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asked the Government of the Republic of Slovenia “a parliamentary question” about patriotic 
education of pupils and about how the integration of citizenship and patriotic education topics 
within different subjects should be accomplished (as well as how much patriotism is already 
included in the textbooks). IEA results were included in the Government’s official (written) 
response (Government of the Republic of Slovenia 2019). Citing the results of the recent ICCS 
2016 study about 90% of pupils agreed or strongly agreed with the statements that the Slovenian 
flag is important, that they feel great respect towards Slovenia, and that in Slovenia we should be 
proud of what we have achieved, around 80% of them agreed or strongly agreed that they are 
proud to live in Slovenia, and slightly less than 70% indicated that it is better to live in Slovenia 
than in most other countries (p. 3). This is of interest also because it shows that sometimes the 
results need to be stated in terms of relatively simple percentages and not item response theory 
scales (which are interpretable relative to other countries’ responses but fail to communicate 
the actual opinions to policymakers or the general public). 


n another indication of impact, the Ministry of Education, Science and Sport adopted a Nationa 
framework for identifying and assuring quality in education (2017), in which the monitoring of 
compulsory systemic indicators is envisaged and listed all existing IEA studies including ICCS. 


For the purpose of this chapter, the titles of professional publications (monographs, articles, and 
national research reports) in the Slovene language that made an explicit reference to ICCS in 
the title (also for master’s/bachelor’s thesis in the key words) were identified from the national 
database Cobiss. We can assume that those publications could also have “impacts” on national 
policymaking or practices in teaching, due to the open source and publication in the national 
anguage (however, daily newspaper articles or conference presentations are not included in 
our analysis). From CIVED 1999, the scientific monograph which was published in 2003 in the 
Slovene language was not open sourced. This means we could expect less “impact” because 
other reports, scientific monographs and papers from ICCS 2009 were open sourced and free. 
Starting with ICCS 2016 reports/monographs are printed in addition to being open sourced. 
Reports/monographs are sent to all schools who participated in the ICCS 2016. Therefore, we 
can expect an even bigger “impact” on educational practices. In the database published for the 
period 2011-2018 (based on ICCS 2009 and 2016 results, with criteria mentioned above) 
several results were found: 3 scientific monographs, 1 special issue of a scientific journal, 4 
research reports, 8 articles, 1 bachelor’s thesis, and 1 master’s thesis (Cobiss 2018), all of them 
in Slovene language. 


However, there are several other possible “impacts” of the CIVED/ICCS study in Slovenia on 
national policymaking and practices. Just to name a few—members coordinating ICCS in Slovenia 
and other researchers from the Educational Research Institute who conduct ILSAs in Slovenia were 
invited as members of a Consultative Body of the Ministers for Civic and Social Competences (in 
2017) and other consultancy bodies for the ministry responsible for education and science (fora 
onger period). It is also sometimes the case that the same researchers are part of ad hoc groups. 
Those associated with ICCS have also been authors/editors of compulsory subject textbooks for 
CCE, undertaken university teaching activities, provided professional teacher trainings and other 
workshops/seminars, been writers/editors of didactical materials and syllabi in the CCE field, 
and served as mass media writers about curricular reforms or other education relevant topics. 
n those activities, the “impacts” of ICCS cannot be separated from other “impacts”. We can say, 
however, that all of those activities have contributed to the “impact” of CIVED/ICCS on national 
policymaking and practices (and to the educational discourse more generally). 


At the beginning of 2019 one of the associations of parents submitted a petition signed by more 
than 20,000 calling for changes in the educational system in Slovenia. The petition warned that 
pupils and parents are overwhelmed with schoolwork and homework; they demanded an end 
to national testing, a shortening of syllabi, school/instruction with no numerical grades—this 
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time for all subjects. The Educational Research Institute responded by showing comparative data 
from different ILSAs, including the last ICCS cycle. The data used for this response from ICCS 
2016 were pupils’ perceptions of Europe's future, their perceptions of the EU, and their life in 
the future. It seems that the discussion of those demands was one of the turning points that 
ed to plans for the preparation of a new White Paper on Education in the Republic of Slovenia. 
Enumeration of the benefits of IEA assessments, including ICCS, is likely to be included. 


Possible Future Contributions of ICCS to Educational Discourse 


Patriotic and citizenship culture and ethics (a compulsory subject in our grade 7 and 8) retains 
a defining feature of its predecessor, namely being a generalist social science and humanities 
subject, with a focus on political literacy, critical thinking, and pupils’ active participation in 
social and civic life. The role of optional (elective) social science subjects in civic knowledge and 
developing attitudes is rather marginal, due to the rarity with which pupils choose those optional 
subjects. However, CCE topics are included in Slovene education across the curriculum or are 
integrated into the entirety of schoolwork. In the last decade, changes to the compulsory syllabus 
in the area of CCE have been relatively minor compared to the transitional years from the early 
1990s onwards. A fear is still present that some teachers will struggle with the adaptations made 
to CCE and also that pupils will have trouble understanding complex political topics that are far 
from their everyday experience. 


Regardless of this, the results of two ILSAs on citizenship education, CIVED 1999 and ICCS 
2009, showed that Slovene pupils have improved their civic knowledge; this is important because 
the general trend in several other participating countries was one of declining civic knowledge 
Schulz et al. 2010). Additionally, some attitudes have improved (especially comparing them to 
those from the cycle in 1999). However, the 2016 cycle showed that our pupils also have a 
positive trend in civic knowledge in comparison to the 2009 cycle. We speculate that most of 
the improvements in Slovenian students’ civic knowledge over the years are due to changes of 
the syllabi and to the greater resources put into the education of teachers of this subject. These 
are projects mainly funded by European Social Funds and other European funds—e.g., Lifelong 
Learning Programme (2007-2013) or Erasmus+ (2014-2020). A great emphasis was put on 
teacher training and we expect it would be the same in the future. This is perhaps also the case 
because the EU emphasizes this topic as important. The biggest area of improvement in the 
future may be in pupils’ engagement in social and political life. But these are contested topics 
that were discussed after Slovenian independence in relation to the (public) education system 
and to the status of religious education (a debate peaking in the late 1990s) and of patriotism 
a more recent debate). The ICCS results have helped to address some of those tensions. 


n 2018, based on the syllabus, anew textbook for the compulsory subject patriotic and citizenship 
culture and ethics (Klemenčič 2018) was prepared and officially approved as one of the textbooks 
that schools can choose. For grade 8, the syllabus prescribes the thematic section “Slovenia, 
EU, world” and further more detailed learning on Slovenia as a member in different international 
organizations (namely UN, OECD, and NATO). In the textbook, IEA is also mentioned (in the 
Slovenian language). IEAis described as a non-profit, non-governmental organization, with more 
than 60 member countries, collecting data on knowledge, attitudes, and other data on education 
in different countries. All areas/fields are mentioned (mathematics, science, reading literacy, 
computer and information literacy, civic and citizenship education) (Klemenčič 2018, p. 53). We 
hope that this will stimulate further discussion about IEA and ICCS in the classrooms. 


Where do we already see other possible future “impacts” of the ICCS study? Slovenia has been 
a member of the EU since 2004. Therefore, it is included in the open method of coordination 
at the EU level, as well as committed to monitor indicators in the field of education. The EU 
prepares new goals for EU countries every decade. Recently an EU expert group prepared “issue 
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papers” on topics, structured with key challenges, opportunities, and priority areas of action, as a 
base for the new Education and Training 2030 Programme (ET2030). One of the papers entitled 
‘Inclusion and citizenship” (European Commission 2019) includes a reference and description 
of the main goal of the ICCS study. Therefore, we can expect that Slovenian policymakers will 
devote attention to this area. The minister responsible for education has made a preliminary 
announcement of the establishment of a new CCE subject in upper secondary school. It will 
b 
a 
a 


e necessary to develop the syllabi based on what we know from ICCS and the performance, 
ttitudes, and engagements of our pupils in grade 8. This has, in fact, already happened. In 2019 
nd at the beginning of 2020 when syllabi for upper secondary schools (namely active citizenship; 
for different educational programs) were in preparation, the argumentation about why this is 
needed used results from ICCS 2016.4 Also, of course, ICCS collects questionnaires from teachers 
and heads of school, the results of which can be of great use. This knowledge was provided to 
inform the development and modernizations announced by minister for strengthening CCE in 
the upper secondary school level. 


n this chapter we have primarily focused on the historical development of CCE in Slovenia 
in elementary school. However, due to the importance that ICCS is putting into investigating 
different perceptions on inequalities, it is worth saying something in this respect. The school 
system in Slovenia provides equal access to CCE, especially from the position of a compulsory 
subject in elementary school where all pupils need to attend lectures and need to be graded in 
the subject. (Other approaches used in our schools are not possible to investigate, because they 
are the responsibility of teachers and schools within their scope of autonomy). Indeed, based on 
the number of classes that schools have, they receive additional resources for extended programs. 
From this, each school decides how it will distribute so-called individual and group support 
(among gifted pupils and pupils with learning disabilities) as well as remedial and supplementary 
classes/instructions (for pupils in need of learning assistance and for pupils who exceed the 
prescribed knowledge standards). Another formal group are pupils with special needs included 
in regular school programs and with the National Institute of Education responsible for decision- 
making. Statistics do not exist (due to the over-complicated system, the possibilities for collecting 
statistics are limited) to check how often this support is devoted for CCE, but we can assume 
that it is not often. The system formally ensures equal opportunities to pupils in acquiring civic 
and citizenship knowledge and attitudes within compulsory and extended programs (as we just 
described). However, teachers from schools often comment informally that those schools that 
are geographically closer to the capital city where political institutions in Slovenia are based, 
have more opportunities to visit them in comparison to other schools distanced from the 
capital city, for which this presents a financial challenge. This is true in spite of the fact that the 
syllabus for the compulsory subject of CCE (for all schools in Slovenia) prescribes teaching about 
those institutions. Perhaps here the state could do more to really assure equal opportunities 
to gain this perspective. Another challenge is the same as in several other educational systems, 
as shown in international reports of ICCS. This is, how to raise civic knowledge among lower 
socioeconomic background pupils. ICCS for Slovenia (and many other participating systems) shows 
correlations between civic knowledge and home socioeconomic status/immigrant background/ 
language spoken at home. These differences favour higher civic knowledge for those from higher 
socioeconomic status families, pupils with no immigrant background, and those speaking the 
language of the test at home. Therefore, those are certainly challenges for the future, not only 
for CCE but for all areas of schooling. 


4 Later in 2020 the decision was made that active citizenship will not be a separate subject but have a descriptor »other 
form of educational work« (e.g., in gymnasiums this is upgrading some parts of so-called mandatory elective topics, so 
that it is mandatory for schools to offer them, but organization of when and how they are offered is up to the schools). 
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As we have shown in this chapter, CCE is important for our educational system in the process 
of change. There are also some indications of direct/indirect “impact” of CIVED/ICCS. We are 
sure that results of ICCS will remain important for different stakeholders (educators, scholars/ 


researchers, and policymakers) in developing this area further. 
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CHAPTER 15: 


Reflections on the IEA Civic Education Study in 
the United States: Policies, People, and Research 


Carole L. Hahn 


Abstract In this chapter, the national research coordinator for the United States (US) in IEA’s 
1999 Civic Education Study (CIVED) reflects on US participation in that study and its legacy, 
especially in light of the fact that the US did not participate in the later ICCS studies. She 
describes decisions related to the qualitative research methods used in Phase | of CIVED, as 
well as findings from it. The main findings from the quantitative Phase II of the study, which 
revealed US students’ civic knowledge, attitudes, and experiences in 1999, are described. Policy 
documents, publications, and subsequent research in the US informed by findings from CIVED 
are discussed. There were extensive contributions to civic education research both nationally 
and internationally from scholars who participated in CIVED and by other scholars who have 
expanded research on themes identified in that study during the ensuing two decades. 


Introduction 


Preparing youth for their roles as citizens in a democracy has long been valued in the United States 
(US). From the early days of the Republic, through the growth of the nation, civic education was 
widely cited as a primary purpose of public schools. Civic education has been delivered through 
particular subjects, such as civics, history, and social studies, as well as across the curriculum 
through extra-curricular activities and school-wide practices, such as mock elections and patriotic 
celebrations. By the end of the 20th century, however, many stakeholders bemoaned declining 
attention to civic education (Carnegie Corporation of New York and Center for Information and 
Research on Civic Learning and Engagement [CIRCLE] 2003). The opportunity to participate in the 
Civic Education Study (CIVED) of the International Association for the Evaluation of Educational 
Achievement (IEA) came at a time in the mid-1990s when increasing numbers of educational 
leaders advocated shining a light on the subject and what they saw as its diminished status. 


The US participated in the first IEA civic education study (Torney et al. 1975) and since the 
1970s researchers had conducted numerous national assessments of students’ civics, history, 
and social studies knowledge. However, in the mid-1990s no recent information was available 
on US students’ civic knowledge, attitudes, and behaviors in comparison to students in other 
countries. CIVED provided an opportunity to obtain such information and to involve US civic 
educators in an international network and discourse on civic education cross-nationally. This 
chapter describes the US portion of the study and some of its key findings before reflecting 
on the subsequent legacy of the study in the US. Policy documents and publications that were 
informed by CIVED findings and that influenced discussions about policies and practices are 
discussed. The subsequent work of scholars who participated in the study and have continued to 
make important contributions to the field of civic education is considered along with the enlarging 
research base on civic education attributable to a growing number of early career scholars. The 
chapter’s conclusion reflects on the contributions of CIVED to the ongoing discourse about 
civic education in the US and cross-nationally. 
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The Study and Key Findings 


As the national project representative for Phase | and national research coordinator for Phase 
| of CIVED in the US, | chaired the National Expert Panel and supervised the collection and 
analyses of data for Phase l; this included a survey of literature, a textbook analysis, focus group 
interviews with teachers and students, and surveys of the 50 state coordinators of social studies 
and representatives of 100 organizations working in the area of civic education in the US (Hah 
1999). For Phase II, | chaired the US CIVED Steering Committee, which advised the America 
nstitutes of Research staff (under contract with the National Center of Education Statistics) 
on conducting, analyzing, and reporting on the quantitative portion of the study in the US (US 
Department of Education 2001). It also involved working with a team of doctoral students at 
Emory University and representing the US at meetings of the international research teams. 


n 
n 


As background to CIVED, | had taught secondary school social studies before joining the faculty 
at Emory University in Atlanta, Georgia. | had been president of the National Council for the 
Social Studies (NCSS, the professional association of social studies educators). For a decade | 
had also been conducting comparative research on civic education in the US and in Denmark, 
England, Germany, and the Netherlands. That study was published as a book, Becoming Political: 
Comparative Perspectives on Citizenship Education (Hahn 1998). The book reviewed research on 
political socialization since the 1960s, paying particular attention to the measurement of political 
interest, political trust, political efficacy, and political confidence, as well as classroom climate for 
discussion and political tolerance. Surveys were administered to adolescents in approximately 50 
schools in five countries in 1985-1986 and 1992-1993. Observations were made of classes, 
and teachers and students were interviewed. As this was not a representative sample, it was 
important not to generalize beyond the sample in each country. Nevertheless, the quantitative 
data did suggest that youth in the study who came from the same country shared some similarities 
with respect to the nature of their political attitudes, gender differences, and classroom climates 
for discussion. Qualitative data from observations and interviews provided insights to facilitate 
understanding of those trends. Importantly, across and within countries, when students had 
opportunities to discuss controversial issues, they reported higher levels of political interest and 
efficacy than did students without such experience. Detailed descriptions of how teachers in 
each country used country-specific approaches to enable students to explore and discuss social, 
political, and economic issues were included. From these data, it was clear there was no single 
preferred way of doing civic education, even in democratic countries that were quite similar. 


At the first meeting of the international CIVED research team in July 1995 in Enschede, the 
etherlands, it became very evident that civic and political education varied considerably across 
national contexts. The national coordinators came to the project meeting with widely differing 
political experiences that shaped what they expected to learn from their country’s participation 
in a cross-national study. Models originating in the US or Western Europe were viewed with 
skepticism by some attendees. The design that was finally approved included a qualitative Phase 
set of case studies that collected information about the current aims of civic education in ea 
country in part to address these concerns. This required a broader set of competencies on the 
part of research staff than would have been the case if the study had been limited to collecti 

data through a test and survey. 


n order to carry out Phase | of the study in the US, a team of Emory University doctoral students 
drew on experiences with both qualitative and quantitative research methods, including those 
mentioned above. It was clear that certain features of US education should be captured in the 
Phase | case study. For example, because education policy in the US is decentralized (to an 
extent that is unlike many other countries), it was important to survey the 50 state-level social 
studies coordinators or their equivalents (identified in the directory of the NCSS Council of State 
Social Studies Supervisors) and to conduct focus groups with teachers and students in different 
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parts of the country. It was also important in selecting a sample of textbooks for analysis to take 
account of differing textbook adoption policies in different US states. Further, it was important to 
conduct a survey of the many organizations involved in US civic education nationally, regionally, 
or at the state level—a unique contextual factor. 


The team presented our findings from Phase I to several US audiences of social studies specialists 
and wrote several publications, including the US case study for the international report (Hahn 
1999). Students in the US tended to have similar experiences with the content of what they 
studied in civic education; however, these students had a variety of experiences with pedagogy 
how civic education was taught). Most 14 to 15-year-old students learned about democracy, 
political institutions, and rights and responsibilities of citizens from lessons in US history and 
from civics courses in grade 8 or 9. The content and sequence of topics varied little across 
textbooks for US history (organized chronologically) and civics (organized according to branches 
of government following the US Constitution). Most 14 to 15-year-olds learned about national 
identity and social cohesion in US history lessons, extra-curricular activities, and the wider society 
around them. Students in focus groups used the terms “we” and “our” in referring to the nation’s 
past, even when their ancestors had not been in the country at the time. Textbooks depicted 
the country as “a nation of immigrants’ and students reported studying about the oppression 
of Native Americans, immigration, women’s history, slavery, segregation, and the Civil Rights 
ovement. Textbooks and students were less likely to mention Latinx and Asians, except in 
states where many individuals from those groups resided. These and other findings from Phase 
provided context for understanding the results for Phase II and they have since been explored 
by other researchers in the US. However, several themes could not be explored directly in Phase 
| because they were not cross-nationally meaningful. 


f one compares the US chapter in the case study book (Hahn 1999) to the case studies from 
other countries, some findings are clearly similar. For example, students before age 14 acquired 
most of their civic knowledge from lessons in history and social studies rather than a specific 
course in civics or government (Hahn and Torney-Purta 1999). The US case study noted that 
although much of the professional literature recommended the exploration of issues and the use 
of reflective inquiry, there was not much evidence of either approach in the textbook analysis or 
the responses of educators in focus groups. Authors of many of the other national case studies 
made similar observations. Although there was a wide variation in the number of participatory 
civic activities that were offered to students in different schools, overall US schools tended to 
offer a substantial number of those activities. US students, like their peers in other countries, 
studied national history and they appeared to develop a sense of national identity (as indicated 
by the use of “our” and “we” as noted above when discussing historic events). US students 
learned about diverse racial and ethnic groups, immigrants, and women who had contributed 
to the nation’s history. However, several scholars noted that more could be done in this area. 
Interestingly, after examining the Phase | case study volume, Hahn and Torney-Purta (1999) 
reflected that no chapter author claimed that their country had a fully successful multicultural 
education program. 


In Phase Il a nationally representative sample of 2,811 US grade 9 students were assessed in 
1999 with the international instruments covering civic knowledge (including civic content and 
skills), concepts, attitudes, and experiences (US Department of Education 2001). An article 
published in the NCSS journal, Social Education, reported that the study yielded good and bad 
news (Hahn 2001). The good news was that overall, US students scored above the international 
mean on the test of civic knowledge—both content knowledge and skills. Further, students who 
reported studying social studies every day performed better on the civic knowledge test than 
their peers who studied social studies less frequently. The bad news was that students who 
attended schools with many students from low-income households, those with few literacy 
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the title Guardian of Democracy: The Civic Mission of Schools. These two reports were widely 
read and frequently cited as several states and school districts increased their requirements for 
courses in civics and/or government and some educators gave greater attention to discussions 
of current events in social studies classes. 


Several other meetings culminated in the publication of further reports making recommendations 
for effective civic education. Experiences with and findings from CIVED contributed to the 
recommendations for policy and practice that were included in these reports (Anderson and 
Landman 2003; Banks et al. 2005; Malin et al. 2014; Torney-Purta and Richardson 2003). 


n 2013, NCSS issued a new recommended framework for the social studies curriculum titled 
The College, Career, and Civic Life (C3) Framework for Social Studies State Standards (NCSS 2013). 
The C3 Framework, which is an aspirational and non-compulsory framework, addresses the 
four disciplines of civics, history, economics, and geography, emphasizing disciplinary concepts 
and use of inquiry. The outcome of student inquiry across disciplines is to be “communicating 
conclusions and taking informed action,’ thus highlighting the civic purpose of social studies. 
The framework, which has guided a great deal of social studies curriculum and instructional 
development in recent years, cites only one article from CIVED (Torney-Purta 2005). However, 
the framework incorporates a number of ideas gleaned from CIVED. The most prominent is the 
importance of classroom discussion and debate of current social problems to enhancing civic 
knowledge. 


Further evidence of CIVED contributing to national discourse on civic education is found in 
several books. CIVED researchers identified two themes that subsequently became the focus of 
several studies. The first theme, inequality of civic opportunities and outcomes, was reinforced 
in research by Kahne and Middaugh (2008) and was the focus of the book No Citizen Left Behind 
by Levinson (2012). The second theme, the importance of controversial issues discussions 
and a “classroom climate” supportive of democratic discourse was reinforced and extended 
by Hess and McAvoy in two books, Controversy in the Classroom (Hess 2009) and The Political 
Classroom (Hess and McAvoy 2015). CIVED had provided important evidence from a nationally 
representative sample of students that students in schools with high poverty populations (often 
serving many students of color) tended to be at a disadvantage with respect to civic education 
and that a supportive classroom climate for discussion was associated with student knowledge 
and expectations of electoral engagement. The authors of these books added in depth qualitative 
evidence from US classrooms to show how teachers can overcome obstacles to provide high 
quality civic experiences for all students. These three books have been read by teachers and 
teacher-educators across the country and have done much to make these issues central in the 
discourse about social studies and civic education reform. In late 2019 the National Academy of 
Education obtained foundation funding to hold a meeting of researchers and prepare an extensive 
report on Educating for Civic Discourse and Reasoning. Several individuals who participated in 
CIVED or in secondary analysis of those data were part of that organizing group or prepared 
papers (Barber et al. 2021). The newest national report is Educating for American Democracy (2021). 


Building a Sense of Community Among CIVED Scholars 


Over the years in which CIVED national research coordinators (NRCs) met with the international 
planning committee to coordinate the study, the researchers learned much from one another 
about the diversity of civic education internationally, bonds were established, and friendships 
formed. NRCs exchanged information about research, publications, and issues and met informally 
at professional conferences, such as the American Educational Research Association, the 
Comparative and International Education Society, and CitizED (a network of scholars interested 
in civic education). When Australia launched a new civic education program, NRCs from the 
US, England, and Hong Kong were invited to speak at a conference in Canberra. Several NRCs 
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they tended to take into account their students’ transnational knowledge, experiences, and 
attachments in quite limited ways. 


The more | have learned about civic education cross-nationally, from CIVED and other studies, 
the more | have come to appreciate the important differences that reflect differing historic and 
socio-cultural contexts. It is important not to generalize findings from one country to another 
and for researchers to provide as much information as they can about the historical and socio- 
cultural contexts of the countries from which their data are obtained. The formation of anetwork 
of comparative civic education scholars has resulted in researchers developing a deepened 
understanding of national and global citizenship. 


However, National Research Coordinators are not the only CIVED scholars who have continued 
to extend civic education research. Several senior scholars were selected to be on the US National 
Expert Panel for Phase | and the US CIVED Steering Committee for Phase Il because of their 
expertise in civic education, and several younger scholars began their careers as doctoral students 
working on the research team for the project. Both groups of individuals have continued to make 
contributions to civic education, social studies, and education broadly. Notably, Walter Parker, 
from the University of Washington, a member of the Expert Panel and Steering Committee, has 
extended his earlier work on diversity and democratic education, the importance of classroom 
discussion, and civic education curriculum development. In recent years he led a team to reform 
the curriculum for civics and government courses. His design-based research places simulations 
and experiential-based learning at the center of instruction (Parker 2018). Patricia Avery, from 
the University of Minnesota, was another senior scholar who brought considerable expertise to 
the US National Expert Panel and Steering Committee’s work. Avery, and one of her doctoral 
students, Annette Simmons, conducted the textbook study for Phase | of CIVED in the US (Avery 
and Simmons 2001). Subsequently, Avery extended her earlier work on students’ civic attitude 
development to a cross national study, supported by the Constitutional Rights Foundation that 
included nine central and eastern European countries (Levy et al. 2011). 


Doctoral students on the Phase | team for CIVED in the US built on their work on the project for 
their dissertations. Extending her interest in the Phase | discussion of social cohesion and diversity, 
Paulette Dilworth conducted studies on multicultural citizenship education. In subsequent years, 
she wrote several publications on diversity and civic education (e.g., Dilworth 2008) and worked 
as a university administrator focusing on diversity issues. A second doctoral student, Trisha Sen, 
extended her work on the CIVED discussion of teaching that connects economic and political 
institutions to her dissertation study of such teaching in the US and India. She has continued 
to work on teacher development and educational reform in India. 


Extending Research Beyond CIVED 


In addition to the research conducted by the CIVED researchers cited above, the next generation 
of civic education scholars in the US has extended findings and methodologies from CIVED. 
Knowles et al. (2018) identified and summarized more than 100 studies that reported analyses 
of CIVED and ICCS 2009 data. In addition to re-examining the original data, numerous scholars 
have extended lines of inquiry established in the CIVED study. Theresa Alviar Martin, Ana Solano 
Campos, and Laura Quaynor used CIVED scales and concepts in their own studies examining 
civic attitudes in samples of immigrant and refugee students in Hong Kong, the US, and Costa 
Rica. In addition to Diana Hess’ research described earlier, Li-Ching Ho, Thomas Misco, and Judith 
Pace have been researching controversial issues, discussions, and civic outcomes in different 
national contexts. Brett Levy (2019) has used multiple methods to improve the measurement of 
and explore the concepts of political efficacy, political interest, classroom climate, and school- 
level civic participation among US students. 
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CHAPTER 16: 


The Personal, the Professional, and the Political: 
An Intertwined Perspective on the IEA Civic 
Education Studies 


Erik Amnå 


Abstract This chapter describes a political scientist's progression from analyses of the 
development of Western democracies to a focused interest in young citizens’ civic knowledge, 
attitudes, and engagement in these democracies. The IEA CIVED data are an important but not 
fully utilized research resource. With some notable exceptions, political scientists often seem to 
isregard the 18 years of preparation of first-time voters. Fueled by the Swedish parliamentary 
democracy commission’s pleas for civic education to build the democratic infrastructure of the 
country, his scope of concern widened into a fascination with the political socialization taking 
place during adolescence in everyday life contexts. The multi-disciplinary IEA studies were a 
major inspiration to create a research team collaborating with developmental psychologists 
and communication scientists. They longitudinally followed 13 to 30-year-old Swedes over 
six years in order to see how political views become shaped in adulthood as alienated, passive, 
active, or standby citizens. More than anyone expected even a decade ago, adolescents have 
entered as major political actors into international, national, and local political arenas throughout 
the world. Political scientists have become curious about what happens in school as well as in 
other contexts. Furthermore, the major threats many democracies are facing in terms of climate 
change denial along with populism can neither be properly understood nor solved without the 
engagement of this generation. 


a 


Introduction 


When scholars in various disciplines consider schools and wonder what they actually mean 
in the process of shaping young citizens and democracies in various nations, they encounter 
publications reporting studies from the International Association for the Evaluation of Educational 
Achievement (IEA), sometimes unexpectedly. This organization and its four studies in the civic 
education content area generously offer researchers large and unique comparative data collected 
with rigorously prepared instruments and analyzed along the highest scientific standards from 
nationally representative samples. In addition, it provides them with transparently developed 
theories, concepts, and instruments, and with detailed reports and archives of data that are 
freely available (CivicLEADS.org). More and more the IEA data have been able to satisfy the 
needs of researchers from fields that are much broader than the founders of the organization, 
who were specialists in comparative education research, would have envisioned. Yet, there is 
more to do in making these data and findings relevant in arguing for the civic dimension and 
centrality of our schools. This is especially true in the democratically troublesome time that has 
recently become ours. Trust is decreasing. Even a high trusting country like Sweden is witnessing 
a small but worrisome loss of trust among its most vulnerable groups of citizens (Rothstein and 
Holmberg 2020). The democratic qualities of the political system of countries such as Turkey, 
Russia, Venezuela, and Nicaragua appear to be weakening. In many parts of Europe populist parties 
are strengthening and receiving increased voter support. What do we foresee about where this 
process will take us? In response, where do we want to take civic education? How can this issue 
about a decreased support in politics and democratic principles be addressed in the future by 
social scientists paying closer attention to understanding the attitudes of adolescents who are 
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developing political opinions that remain with them into adulthood? | am a political scientist, but 
this chapter will reflect on these issues from personal and professional points of view as well. 
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pleased to find a striking predictability from our use of the CIVED data. These two studies were 
realized thanks to a fruitful and decade-long cooperation with Dr Ingrid Munck, a gifted statistician 
who also had been deeply involved in the first generation of IEA studies of citizenship and civic 
education. Note that she has remained active in analyzing IEA’s data with a recent publication 
about the scale measuring support for immigrants’ rights (Munck et al. 2018). 


In the next step, my personal interest in young people's civic and political engagement was 
further energized. When given the privilege to drive Pippa Norris, an internationally known 
political scientist, from Oslo Airport to a doctoral course on the Swedish North-west coast, 
our conversation turned to the current state of political socialization research. In particular, we 
shared our worries about the lagging interest that our discipline was demonstrating in an area 
that had shown such theoretical and methodological strength a few decades before. 


After this encounter | developed the ambition to develop a Swedish longitudinal study on the 
civic and political development of adolescents and young adults. Since then | have been deeply 
involved in a professionally fascinating and demanding cooperation exploring how political 
socialization evolves through activities in families, peer networks, schools, social media, and 
associational life. At the young Orebro University, founded in 1999, | found prominent colleagues 
in development psychology, pedagogics, and media and communication studies whose research 
interests showed a promising overlap with the challenges that had occupied me ever since 
my work for the Commission on Democracy. Ten years after our report was presented to the 
government | now am able to address some of these challenges with research data. When the 
incoming advisory board met for the first time, one of its members, Judith Torney-Purta made 
sure that the new research program was informed about the vast experiences from the IEA civic 
education studies theoretically as well as methodologically. 


Professional Perspectives 


The IEA data have contributed a great deal to my research. | have been involved in various 
analysis, workshops, seminars, conferences, and publications utilizing IEA's civic education data. 
In a recent conference in collaboration with the Nordic ministers of Education, | invited scholars, 
teachers, school policymakers, and student representatives to approach the mission of the Nordic 
school in democratically troubling times. In keynote speeches and seminar presentations, IEA's 
International Civic and Citizenship Education Study (ICCS) 2016 played a significant role. Barbara 
Malak-Minkiewicz, who has been a leader in IEA’s civic studies for more than 25 years, presented 
the Nordic students’ results under the both encouraging and challenging metaphor of a lighthouse. 
She argued for approaching civic education as running for a target that is moving all the time 
while the contexts of the schools are changing over time (Carstens and Malak 2019, p. 19). 


During the spring of 2019 | took part in the first Advisory Committee meeting preparing ICCS 
planned for 2022 (having been part of these deliberations since 2014). One of the topics | brought 
up for discussion is how we can bridge the traditional gap between the political scientists’ focus 
on the interest and attitudes dimensions and the educationalists’ interest in the knowledge 
dimensions. | will come back to this challenge later in this chapter. 


My overall impression is that for too long the field of political science has unfortunately been 
neglecting the IEA civic education data and its findings. The first real attempt | made to wake 
up my colleagues was in a joint project with a junior political scientist. We were curious to 
compare youths from Northern and Southern Europe concerning their democratic attitudes and 
particularly their willingness to act politically. We aimed at matching the IEA CIVED data with 
data from the youngest respondents of the European Social Survey. It was a way to show how 
the data could illuminate vital research questions about the political and civic role of the school 
in democracies. We were surprised with the finding that young citizens in more established 
democracies seemed less activist oriented than those in the same generation living in less mature 
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democracies, while their parents showed an opposite pattern. 
the ambitious orientations they perhaps had during adolescence and give up these possibilities 
Do the seemingly passive Nordic adolescents turn into activists as 
they start to notice problems or a need for common efforts? What was the role of 
these two different political contexts? In addition, the unique data were also suitable 
comparative research about young people’s civic engagement and 
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Looking ahead, the schools’ capacities to promote a civic culture as a democratic infrastructure of 
the democracies seems to be a key part of human development in a time of dramatic challenges. 
Around the world, democratic regimes are far from being “the only game in town” that many 
have worked for globally. On the contrary, democracies are tested and challenged, not least by 
many youths on both the left and right who want changes and hope for a secure and sustainable 
future for themselves. 
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(lacking both majority rule and political liberalism) to be the main threat to our democracies? 
The ability to understand and defend democratic ideals has to be improved but also we need 
critical reflection on existing democracies from various perspectives. Some of those reflections 
may need to be accessible for students with diverse reading capabilities (Arensmeier 2015). 


Fostering tolerance represents a second area in which liberal democracy is becoming contested 
globally. As | touched upon above, | can see at least two general causes. Migration processes 
constitute a continuous challenge for our societies. The United Nations High Commissioner for 
Refugees has shown that in 2017 there were about 25.4 million refugees around the world. As 
few as 10 countries are hosting 60% of the refugees. In these countries and others with a great 
influx of immigrants, tensions due to diverse social habits and expressions of religious traditions 
and beliefs are evident. 


Another tendency that may explain growing uncertainty has to do with the development of 
education and democracy itself. Increased socioeconomic level appears to generally be followed 
by changes in values that downplay loyalty, tradition, and stability while favoring self-expressing 
values of individuality and authenticity. This is true for social, religious, political, territorial, and 
sexual identities. This deep value change means an expanded room for negotiations about 
identities and finally an enlarged variety of differing identities. In many countries it leads to 
stringent challenges to tolerance towards diversity. For some countries, like the Nordic ones, it may 
be one of the first real tests of what is widely believed to be their world-leading high standards 
of tolerance. There is some evidence that males are less likely than females to practice such 
tolerance. All over Europe, political movements have gained great popularity among the citizens 
by exploiting and condemning diversity most notably by blaming the newly arrived refugees 
for most of the problems facing their states. More than we may have expected, schools not 
only can pave the way for independent thinking but have to recognize its mission to safeguard 
humanistic democratic principles. Teacher education needs to place more emphasis on personally 
encouraging and professionally arguing for upgrading their role as defenders of democracy. 


Stimulating public interest in balancing the individualizing and self-actualizing forces of citizen 
norms in the process of common problem solving is crucial for the future development of our 
democracies. Political scientists continue to remind us about the powerfulness of political interest 
in all aspects of individuals’ knowledge, attitudes, and activities in politics (Prior 2018). In this 
light we do not actually know much about “political” interest (Fitzgerald 2013) or about why it 
actually grows (Stattin et al. 2017). However, we know that people's concepts of politics correlate 
with gender, ideology, and nationality. We also know when this important but somewhat vague 
curiosity about politics develops (Prior 2018; Russo and Stattin 2017; Flanagan 2013). Political 
interest in particular seems to develop between the ages of 13 to 15, if it develops at all. Since 
we also know that political interest as well as civic knowledge correlates with (good or bad) 
feelings about politics, this should be recognized in classrooms. Hopes and worries regarding the 
climate currently seem to be a major factor explaining political interest and political participation. 


motions about politics seem to be tightly associated with political interest and civic knowledge. 
urthermore, a seemingly robust disinterest can be turned into some level of political engagement 
though it may have a different focus from that recognized in older generations. In part, this is 
one thing we can learn from the seemingly rapid growth of electoral support for populist parties 
in European politics. 


nthe last analysis, civic education takes place in changing global contexts and conflicts concerning 
climate, economy, poverty, inequality, and politics. Moreover, the changes and conflicts require 
continuous open-minded reflections and experiments on the ways in which we deal with conflicts 
righteously and peacefully. Is there a more sustainable way to defend democracy? 
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CHAPTER 17: 


Joining an International Community of Practice: 
Reflections on the IEA Civic Education Studies 


Carolyn Barber 


Abstract This chapter presents reflections from an educational researcher who began her 
involvement with the project as an early career scholar soon after the release of the first IEA Civic 
Education Study (CIVED) report nearly two decades ago. She describes the secondary analysis of 
these data that took place, especially in the ensuring decade, along with ways in which involvement 
with the IEA civic education studies shaped her own professional development and that of others. 
She describes joining the large and small communities of researchers (going back to the first IEA 
nternational Research Conference) and reflects on how the IEA civic education studies have 
shaped approaches to studying educational processes and the development of social attitudes in 
students. In particular, the nature of these data and emerging statistical methodologies allowed 
the exploration of the role of contextual factors in civic development. Second, cross-disciplinary 
collaborations with international specialists in the social and behavioral sciences (as well as 
educational researchers) provided perspectives that broadened the educational or developmental 
psychology approaches common in the United States. The benefits and challenges of work with 
large-scale data and with interdisciplinary and cross-national collaboration are highlighted. Links 
to the datasets and to lists of publications are described. 


Introduction 


The first International Research Conference (IRC) of the International Association for the 
Evaluation of Educational Achievement (IEA) in Nicosia, Cyprus was an introduction for many to 
the opportunities for secondary analysis of data from the 1999 IEA Civic Education Study (CIVED) 
and to the international communities of researchers undertaking this work. In the year leading 
up to this conference, | had been a doctoral research assistant at the University of Maryland, 
analyzing CIVED data on topics such as educational inequality, adolescents’ sense of political 
trust, and democratic school participation. However, IEA IRC attendees represented a broader 
international community of researchers with a common interest in IEA’s international studies 
across subject areas, including international leaders of the studies alongside researchers with 
both substantive and methodological expertise in working with the studies. 


This was an intentional feature not only of the IEA and CIVED research community, but of the 
CIVED study itself, as illustrated in the conceptual framework created several years earlier to 
guide the study. Specifically, Torney-Purta et al. (2001) cited “communities of practice,” a concept 
used by Lave (1991) to describe how individuals learn through shared interactions with members 
of a community with common goals. Individuals begin observing or taking on an apprentice role, 
and gradually move to more central roles in the group. This sociocultural perspective on learning, 
which was key to the CIVED steering committee's conceptualization of 14-year-olds’ civic learning, 
has also been applied to doctoral and post-graduate education (Carretero et al. 2016; Shacham 
and Od-Cohen 2009). As a researcher beginning doctoral study just as the CIVED study data 
were being made available for secondary analysis, my communities of practice, like those of 
many early career scholars who have published based on these studies (e.g., Isac, this volume; 
Pizmony-Levy and Torney-Purta 2018; Sandoval Hernandez et al., this volume) were shaped by 
the scholarly approaches and values of the researchers working on this study. 
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Background: Early Career Development and Introduction to IEA 


Working with large-scale datasets had been part of my studies in sociology at Johns Hopkins 
University, where | analyzed data from the universe of public secondary schools in the United 
States (rather than samples of students). However, interest in the interplay between the contexts 
of schools and the lives of the students who attended them led me to pursue graduate study 
in human development at the University of Maryland (College Park), specializing in educational 
psychology. There, | joined the CIVED research team led by Judith Torney-Purta and Jo-Ann 
Amadeo, who had been with this project from its inception nearly 10 years earlier. The CIVED 
project’s book of national case studies (Torney-Purta et al. 1999) and report on international 
comparisons of 14-year-olds in CIVED (Torney-Purta et al. 2001) were already available. The 
upper-secondary report had recently been published (Amadeo et al. 2002), and a few special 
issues of journals relating to the studies were being developed. Most project leaders at the 
international coordinating center at Humboldt University of Berlin were returning to other 
responsibilities. At the University of Maryland, a plan was underway to develop an infrastructure 
to encourage researchers to use these cross-national civics data in further analyses, and to 
present the results of in-depth secondary analysis to a wide range of international audiences 
interested in youth development generally and more specifically in civic education. 


= 


was clear that developing the full potential of these data would require resources for secondary 
analysis, and a proposal to the W. T. Grant Foundation to support this work had been funded. 
dependently, William Galston and Peter Levine had recently established the Center for 
formation and Research on Civic Learning and Engagement (CIRCLE), in the School of Public 
Affairs at the University of Maryland (and later moved it to Tufts University in Massachusetts, 
where it remains influential). CIRCLE’s leadership was interested in disseminating brief reports of 
empirical studies to scholarly, practitioner, and policymaker audiences interested in youth civic 
engagement. This provided a way to disseminate short user-friendly presentations of findings 
from CIVED secondary analyses on topics such as media usage (Amadeo et al. 2004) or patterns 
of civic knowledge (Torney-Purta and Barber 2004). 


I 


I 


=) 


The team from the University of Maryland also obtained funding from CIRCLE to establish the 
Civic Education Data and Researcher Services Center (CEDARS), whose goal was to encourage 
the use of data from the IEA civics studies by providing technical support, short reports for 
interested researchers, and enhanced datasets including scores on scales not included in the 
international data files. A collaborator in this work on the expanded datasets was Vera Husfeldt, 
who visited Maryland in 2005 after her decade of work in the international coordinating center 
for CIVED at Humboldt University (Husfeldt et al. 2005). This report, available on the University 
of Maryland website, details eight additional attitudinal scales derived from the IEA CIVED data, 
including attitudes toward ethnic minority groups and protective attitudes toward one’s nation 
to supplement the 12 scales available on the IEA data sets." 


During doctoral studies | co-authored a number of articles, technical reports, and research briefs 
communicating CIVED research results to policymakers and educators while also working as a 
consultant on statistical issues and on substantive issues pertaining to classroom and school 
climate. In 2007, | accepted a faculty position at an urban research university in the Midwestern 
United States, with the expectation of sustaining a coherent line of scholarship. Analysis of 
the civics studies (first CIVED, then later the IEA International Civic and Citizenship Education 


1 Fora considerable period of time the datasets were available only through the IEA organization’s website. However, 
recently they were archived by the CivicLEADS Project, which manages a collection of datasets in this area at the 
Interuniversity Consortium for Political and Social Research (Regents of the University of Michigan 2020). About one 
third of the researchers who download the IEA CIVED and ICCS datasets from CivicLEADS are from outside the 
United States. The CivicLEADS website also provides a list of publications reporting analyses of these data, which 
can serve as a resource to scholars interested in identifying understudied research issues and choosing a journal for 
the submission of an article. 
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Study [ICCS] of 2009) served as the core of this scholarly agenda. Taking a faculty position also 
meant expanding roles as a mentor. This resulted in a research team to encourage students’ use 
of several large-scale datasets to answer questions of interest to counseling and educational 
psychologists (e.g., Barber and Ross 2018, 2020; Barber et al. 2015). The communities of practice 
idea served as a model when forming this team. 


Arriving at the University of Maryland just as potential for secondary analyses of the CIVED data 
was being recognized created a unique experience for professional development. However, some 
aspects of this experience can be generalized to working with large-scale, cross-national survey 
data in a variety of settings. The remainder of this chapter highlights three specific examples 
of this. First is a discussion of how analyzing large-scale civics data supports substantive and 
methodological approaches to educational research and psychology. Second, is a description 
of the interdisciplinary community that began more than 10 years ago and continues to be 
important for conducting research with such data. Finally, there are comments about the value 
of international collaborations for this work more generally. 


Preparing Educational Psychologists to use Large-Scale Civics Data 


Educational psychologists are interested in understanding how young people develop within 
earning environments, including consideration of both the contextual features of the environment 
and their interactions with individual characteristics. The use of representative data sets, 
particularly from multiple countries, allows the exploration of development in varied cultural and 
political contexts; this is seldom a strong feature of research in this area of psychology given its 
focus on smaller and non-representative samples. The IEA civics data sets provide large enough 
samples and a broad enough range of variables to analyze contextual variation in a meaningful way. 


Contextualized Approaches to the Study of Educational Psychology 


Like other branches of the discipline, educational psychology has historically relied on studies 
from non-representative and local data sources (a fact that Duncan, 1991, documented and 
lamented in developmental psychology several decades ago). However, results from such 
studies have limited contextual variability and often fail to generalize meaningfully to broader 
groups. Enhanced external validity is a benefit of conducting secondary analyses on nationally- 
representative datasets. One key way in which work with the CIVED/ICCS studies can have 
an impact upon educational psychologists is by making them sensitive to issues of context and 
generalizability. Mueller and Hart (2008) noted that a benefit of large-scale surveys, above and 
beyond their generalizability, is the ability to understand which aspects of context are most 
relevant to psychological and educational processes and outcomes. It is usually the case that 
large and varied samples are required to ensure sufficient power and variability to look within 
and between groups of students in order to examine moderating effects of context and culture. 


Professional socialization in the context of the IEA civics studies can provide interested scholars 
with the tools to consider such interactions between process and context. One approach, for 
example, is to conduct regression models in multiple countries in order to consider how similarities 
and differences in findings, as was done to illustrate varied developmental processes in the growth 
of trust across national contexts (Torney-Purta et al. 2004). A second approach, using more 
advanced statistical methodologies, is to examine country-level characteristics alongside and 
in interaction with individual predictors of youth outcomes (e.g., Barber et al. 2013; Sandoval- 
Hernandez et al. 2018; Torney-Purta et al. 2008). With large sample sizes it is also possible to 
conduct robust analyses comparing predictors of student outcomes by gender, ethnic identity, 
or immigrant status (Barber and Torney-Purta 2009; Barber et al. 2015; Torney-Purta et al. 
2007). For example, within the broader community of psychologists, Diemer and Rapa (2016), 
and Godfrey and Grayman (2013) have used CIVED data from the United States to examine the 
experiences of members of minoritized racial groups using moderation or multi-group techniques. 
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Many benefits of working with large-scale databases for educational researchers apply regardless 
of content area; in other words, similar benefits would be gained from looking at large-scale 


studies of math, science, or literacy. However, there are some features of large-scale studies of 
civic education (and their secondary analyses) that are worth highlighting. For one, compared to 
large-scale studies in other subject areas, the CIVED/ICCS studies have paid particularly close 
attention to the development of strong measures for the assessment of social context and of 


processes (noted in the review of 100 articles of secondary analysis of these data by Knowles 
et al. 2018). Of particular importance are measures of classroom climate, opportunities for 
student voice in the school, and (beginning in the ICCS 2009 study) perceptions of student/ 


teacher relationships. These variables have expanded the potential of these data sets for those 


interested in understanding educational contexts cross-nat 


tionally (e.g., Reichert et al. 2018) and 


secondary analyses incorporating these variables were featured prominently in an examination 
of learning environments as supports for civic reasoning and discourse sponsored by the United 


States-based National Academy of Education (Barber et a 


. 2021). 


The focus on participatory intensions and on attitudes alongside civic knowledge as outcomes 


has expanded interest in studying how context may shape 


ey aspects of development. An early 


product of the team at Maryland was a “28-country database” containing national indicators 


for countries participating in the CIVED study. While ma 


ny of these variables can be studied 


in relation to knowledge (a classic outcome for educational psychologists regardless of subject 
area), indicators added to this data source have also been used to predict citizenship norms 


(including those pertaining to human rights), inclusive attitudes toward participation, and political 
self-efficacy (Barber et al. 2013; Barber and Torney-Purta 2009; Torney-Purta et al. 2008). 


Methodological Expertise for Large-Scale Data Analyses 


To ensure national representation, the CIVED and ICCS surveys employed a complex sampling 
design (clusters of students within a stratified random sample of schools), and it is vital to weight 
and account for design effects before making claims about a representative sample. In addition, 
there are data that can be taken into account from students, teachers, schools, and countries. 
As acknowledged in the previous section, training in statistical methodologies appropriate for 
nested data, such as multilevel modeling, allows researchers interested in working with CIVED 


and ICCS to take more complete advantage of these data. For example, an early secondary 
analysis by the team at Maryland used multilevel modeling techniques to link teachers’ attitudes 


and training to students’ outcomes in the subset of countries where direct linking of students to 
teachers could be supported (Torney-Purta et al. 2005). This remains one of the few attempts 


to link specific teachers with their classes. 


To place the contributions of such work in perspective, it is important to note a conclusion in 
a handbook chapter describing the potential contribution of secondary data sources (such as 


CIV 


D and ICCS) to research in social studies education. Heafner et al. (2016) concluded that 


the lack of training to analyze data from complex surveys has been a barrier to many researchers 


who have substantive interests in research on social studies and civic engagement. While it 
is not necessary to receive a degree in statistics to work with large-scale data, developing 


methodological expertise is vital. While some challenges (suc 


h as appropriately utilizing sample 


weights) are characteristic of work with large-scale data across subject areas, working with civics 


da 
on 
ou 


rating scales rather than the right/wrong items found i 


tlined both in the technical reports for CIVED (Schulz and 


tasets can be especially challenging due to the focus on attitudinal/behavioral data measured 


n assessments of knowledge. As 
Sibberns 2004) and ICCS (Schulz 


et al. 2011), as well as several secondary data analyses (e.g., 
2018), polytomous items add another level of difficulty to the already complex measurement 
characteristic of large scale assessments. 


Husfeldt et al. 2005; Munck et al. 
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In many cases, researchers working with CIVED/ICCS data expand their community of practice 
by networking with others interested in effectively using large-scale datasets, in order to remain 
aware of up-and-coming methodologies, analytic tools, and data sources. Special interest 
groups (SIGs) in the American Educational Research Association (AERA) and the Comparative 
International Education Society (CIES) have been instrumental in developing and sustaining this 
network, and researchers working with the civics data have served in leadership roles within these 
groups. Such SIGs promote and highlight work with large-scale data by sponsoring conference 
sessions, featuring datasets and their secondary analysis in newsletters and other publications, 
and presenting awards to particularly exemplary pieces of scholarship. 


Cross-disciplinary Collaborations 


In these groups organized around methodology, membership is drawn from across disciplinary 
backgrounds. In fact, some of the most valuable discussion takes place when subject-area 
educators, educational policy scholars, and methodologists have the opportunity to communicate. 
This speaks to another feature of work on CIVED and ICCS: work with these datasets brings 
together researchers from multiple disciplines. Scholars such as Duncan (1991) and Friedman 
(2007) have long highlighted the potential for secondary analyses to support opportunities for 
interdisciplinary collaboration among scientists. Such opportunities are particularly prominent 
in the CIVED and ICCS studies, as the measures they included have been drawn from a wide 
range of areas and have received widespread interest from a range of social and behavioral 
scientists: political scientists, educational researchers (especially those interested in social 
studies), psychologists, sociologists, comparative education researchers, social policy specialists, 
and political psychologists (a feature noted in the literature review from Knowles et al. 2018). 
Although disciplines differ in their approaches, there has nevertheless been a sense of membership 
in a common research community shared by those working with these data. 


y own professional identity as an educational psychologist has been enriched by interdisciplinary 
collaborations working on the civic data with statisticians (Munck et al. 2018), political scientists 
Maurissen et al. 2018, 2020), public policy researchers (Barber et al. 2013), and educational 
researchers from social studies (Knowles et al. 2018). For example, research on country-level 
moderators of attitudes toward immigration was facilitated by the opportunity to collaborate 
with a social policy researcher with expertise on immigration (Barber et al. 2013). Similarly, 
work with a statistician was crucial in introducing cutting-edge methodologies to the study of 
measurement invariance across cohorts using CIVED and ICCS data (Munck et al. 2018). As a 
historical note, the senior author of that article began as an early career scholar associated with 
the IEA studies during the 1970s at Stockholm University. The range of disciplines represented 
by the chapter authors in this volume provide further evidence of the interdisciplinary nature 
of the civic education studies. 


Projects conducted both with CIVED/ICCS and other data sources and methodologies show 
that interdisciplinary research ultimately benefits from taking multiple approaches to a problem. 
Work with researchers in fields such as social studies education and social/educational policy has 
been important in considering the practical application of civic education research findings. In a 
recent interdisciplinary and international collaboration using ICCS data with political scientists, 
reviewing the work of educational psychologists provided new insight on social aspects of 
schooling (Maurissen et al. 2018). Such approaches can also come to define work conducted 
by researchers even when not using CIVED or ICCS data. 
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International Collaborations 


Researchers working with the data from the civics studies have come from multiple countries i 


addition to coming from multiple disciplines. It is imp 


community find opportunities to come together, to share themes from their work and identify 


avenues to collaborate jointly on future projects. IEA 


CIVIC AND CITIZENSHIP EDUCATION STUDIES 


eS 


ortant that members of this internationa 


IRCs have a dedicated strand devoted to 


civic education, which tends to attract the same audien 


later ICCS) strands at the first IEA IRC in Cyprus, and the subsequent seven conferences held 
across the world, have illustrated this point. Other national and international research conferences 
(e.g., American Political Science Association, Comparative and Internationa 


ce members for every session. CIVED (and 


Education Society 


and the International Society for Political Psychology), and internal seminars for policy groups 
and funders (e.g., the Joint Research Centre of the European Commission) have provided similar 


experiences. Even though opportunities for electronic 
conference in person gives researchers important oppo 


communication have expanded, being at a 
rtunities to hear perspectives face-to-face, 


and to spend time together in discussions outside of formal meetings. While videoconferencing 


time in collaboration should not be discounted. 


nternational collaboration is also fostered by personal 
weeks in Sweden, at Orebro University working with E 


techniques in civic education research, drawing an au 


technologies have become increasingly valuable (even essential), the benefits of face-to-face 


visits to universities. In 2011, I spent two 
rik Amna, Hakan Stattin, and colleagues in 


their Youth and Society Centre. This included a workshop on cluster-analytic (person-centered) 


dience from across the Nordic and Baltic 


region. Later, during a sabbatical in 2016, | spent three months as a visiting scholar with the 
Centre for Political Research at the University of Leuven, working with Ellen Claes and the ICCS 
2016 team from Flanders and participating in departmental colloquia with them (as well as with 
Marc Hooghe and his research team). Such extended stays facilitated consultations with scholars 
at all levels that would not have been possible at a conference. They also allow one to witness 


how differences in cultural context and policy priori 


ties shape the approaches to encouraging 


young people to develop as citizens (and the research questions to be pursued). 


Such collaborations require both skills (e.g., in n 


avigating cultural differences in work 


environments) and resources to provide opportunities to hone these skills. Senior researchers 
can provide support for travel and leverage their networks to identify arrange the necessary 


connections for collaboration—key resources for an ear 
Beyond individual supports and connections, the Nati 


ly career researcher (Flanagan et al. 2015). 
onal Research Council's (2014) report on 


strengthening international research collaborations in the social sciences focused on multiple ways 
in which home institutions could support faculty's international collaborations (e.g., through travel 


grants to international conferences and support for res 


earch leaves). This aspect of collaboration 


extends back 50 years in the history of the IEA network, stemming back to when the six subject 
area survey was headquartered at Stockholm University. Funding from the Spencer Foundation 
supported early career post-doctoral fellows, including several from the United States as well as 
from Finland and Hungary, who worked closely with more senior scholars on several projects. 
Similarly, my own ability to participate in international research collaborations was supported 


both by senior scholars in the field (including but by no 
and by financial support from both my university and 


Conclusion 


Mentors and colleagues met through work with CIVE 


means limited to the editors of this book) 
external Sources. 


D and ICCS have provided an enriching, 


interdisciplinary, and international community of practice for my research. Many other scholars 


of this generation and earlier generations have benel 


community in which it resides, provides not only a da 
increasingly, opportunities to mentor up-and-comin 


fited in similar ways. This work, and the 
ta source for empirical research, but also 
g researchers through conducting new 
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secondary analyses and synthesizing existing work (e.g., Knowles et al. 2018; Maurissen et al. 
2018b). Once again true to sociocultural approaches to understanding learning, it has been the 
experiences in these groups tied to CIVED/ICCS that has given scholars of my generation specific 
skills to conduct research and to become productive members of professional communities 
contributing to educational discourse internationally in the field of civic education. This generation 


is already establishing its leadership and carrying on this tradition. 


References 

Amadeo, J., Torney-Purta, J., & Barber, C. H. (2004). Attention to media and trust in media sources: Analysis 
of data from the IEA Civic Education Study (CIRCLE Fact Sheet). College Park, MD: Center for Information 
and Research on Civic Learning and Engagement, University of Maryland, College Park. http://circle.tufts. 
edu/sites/default/flles/2019-12/FS_AttentionTrustinMediaSources_2004.pdf 
Amadeo, J.-A., Torney-Purta, J., Lehmann, R. H., Husfeldt, V., & Nikolova, R. (2002). Civic knowledge and 
engagement among upper secondary students: Citizenship and education in sixteen countries. Amsterdam, the 
etherlands: International Association for the Evaluation of Educational Achievement (IEA). 


Barber, C., Clark, C., & Torney-Purta, J. (2021). Learning environments and school/classroom climate 
as supports for civic reasoning, discourse, and engagement. In C. Lee, G. White, & D. Dong (Eds.), 
Civic reasoning and discourse (pp. 175-220). Washington, DC: National Academy of Education. https:// 
naeducation.org/wp-content/uploads/2021/03/Chapter-6.pdf 


Barber, C., Fennelly, K., € Torney-Purta, J. (2013). Nationalism and support for immigrants’ rights among 
adolescents in 25 countries. Applied Developmental Science, 17(2), 60-75. https://doi.org/10.1080/108 
88691.2013.774870 


Barber, C., & Ross, J. (2018). Cross-cohort changes in adolescents’ civic attitudes from 1999 to 2009: 
An analysis of sixteen countries. Child Indicators Research, 11(2), 681-703. https://doi.org/10.1007/ 
512187-017-9452-0 


Barber, C., & Ross, J. (2020). Profiles of adolescents’ civic attitudes in sixteen countries: Examining cross- 
cohort changes from 1999 to 2009. Research in Comparative and International Education, 15(2). https:// 
doi.org/10.1177/17454999 20910583 


Barber, C., Sweetwood, S. O., & King, M. (2015). Creating classroom-level measures of citizenship 
education climate. Learning Environments Research, 18, 197-216. https://doi.org/10.1007/s10984-015- 
9180-7 


Barber, C., & Torney-Purta, J. (2009). Gender differences in political attitudes and efficacy as influenced by 
national and school contexts: Analysis from the IEA Civic Education Study. In D. Baker, & A. Wiseman (Eds.), 
Gender, equality, and education from international perspectives (pp. 357-394). International Perspectives 
on Education and Society, Volume 10. Bingley, United Kingdom: Emerald Group Publishing. 


Barber, C., & Torney-Purta, J. (2012). Comparing attitudes in the 1999 and 2009 IEA Civic and 
Citizenship Education Studies: Opportunities and limitations illustrated in five countries. Journal of Social 
Science Education (Journal für sozialwissenschaftliche Studien und ihre Didaktik), 11(1), 47-63. https://doi. 
org/10.4119/UNIBI/jsse-v11-i1-1191. 


Barber, C., Torney-Purta, J., Wilkenfeld, B., & Ross, J. (2015). Immigrant and native-born adolescents’ 
civic knowledge and attitudes in Sweden and the United States: Emergent citizenship in 
developmental niches. Research in Comparative and International Education, 10(1), 23-47. https://doi. 
org/10.1177/1745499914567818 
Carretero, M., Haste, H., & Bermudez, A. (2016). Civic education. In L. Corno, & E. M. Anderman (Eds.), 
Handbook of educational psychology (pp. 295-308). New York, NY: Routledge Publishers. 


Diemer, M. A., & Rapa, L. J. (2016). Unraveling the complexity of critical consciousness, political efficacy, 
and political action among marginalized adolescents. Child Development, 87(1), 221-238. https://doi. 
org/10.1111/cdev.12446 


Duncan, G. (1991). Made in heaven: Secondary data analysis and interdisciplinary collaborators. 
Developmental Psychology, 27(6), 949-951. https://doi.org/10.1037/0012-1649.27.6.949 


Flanagan, J. C., Barrett, E. L., Crome, E., & Forbes, M. (2015). Developing international collaborations for 
early career researchers in psychology. The Behavior Therapist/AABT, 38(5), 131-134. 


Friedman, S. (2007). Finding treasure: Data sharing and secondary analysis in developmental science. Journal 
of Applied Developmental Psychology, 28(5-6), 384-389. https://doi.org/10.1016/j.appdev.2007.07.001 


202 


Godfrey, E. B., & Grayman, J. K. (2013). Teaching citizens: The role of open classroom 
critical consciousness among youth. Journal of Youth and Adolescence, 43(11), 1801 


INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


org/10.1007/s10964-013-0084-5 


Heafner, T. 
and second 
Cuena (Eds 


usfeldt, V., 
participatio 
College Par 
€ 


comparative ri 
7-30. https:// 
Lave, J. (1991 
2,63-82. 

aurissen, L. 
immigrants: T 


ary data analysis as tools to 
.), Rethinking social studies teacher education in the twenty-first century 
Switzerland: Springer. 


EDARS%20new%20Oscales%20report. 
nowles, R. T., Torney-Purta, J., & Barber, C. 


doi.org/10.1057/541269-018-0114-0 


aurissen, L., Claes, E., € Barber, C. (2018). Deliberation in citize 


Barber, C., € Torney-Pur 


pdf 


esearch: Analyse 
doi.org/10.1386/ctl.13.1.7 1 


). Situating learning in communities of p 


, Barber, C., & Claes, E. (2020) 
he importance of mutual respec 


. Classro 
and res 


context contr 


O 


unck, 


CCS. So 

ationa 
social an 
https://d 


ernati 
https://d 
Regents 
sharing. 

Reicher 
classroo 


https: 


n climate and students’ 


ta, J. (2005). Students’ social attitudes a 
n: New scales in the enhanced database of the IEA Civic Education Study. (CEDARS Report). 
, MD: University of Maryland. http://terpconnect.umd.edu/~jtpurta/Ori 


2018). Enhancing citizenship learn 
s of IEA Civic Education datasets. Citizenship Teaching and Learning, 13(1), 


L., Fitchett, P. G., & Knowles, R. T. (2016). Using big data, large-scale studies, 
inform social studies teaching and learning. 


p 


8 


na 


climate in fostering 
|-1817. https://doi. 


secondary datasets, 
nA. R. Crowe, & A. 
p. 359-383). Cham, 


expected political 


inal%20Documents/ 


ing with international 


ractice. Perspectives on Socially Shared Cognition, 


om discussions and political to 
ponsiveness. Acta Politica, 55, 242-266. https:// 


ibutes to the development of an open c 


21(4), 951-972. https://doi.org/10.1007/511218-018-9449-7 
ueller, C. E., & Hart, C. O. (2010). Effective use of secondary data an 
pportunities and challenges. Gifted Children, 4(2), article 3. 


., Barber, C., & Torney-Purta, J. (2018). Measurement invariance in compari 
immigrants among youth across Europe in 1999 and 2009: The Alignment Method app 
ciological Methods and Research, 47(4), 687-728. https://doi.org/10.1177/0 

Research Council. (201 
d behavioral sciences: Summary of a workshop. Washington, DC: The Natio 
oi.org/10.17226/1897 


mony-Levy, O., & Torney-Pu 


O 


//WWwW.iCpsr.umic 


erance towards 


nship education: How the school 


assroom climate. Social Psychology of Education, 


alysis in gifted 


4). Building infrastructure for international collaborati 


education research: 


ng attitudes towards 
ied to IEA CIVED and 
049124117729691 


ve research in the 


and Adolescence, 47, 1279-1298. https://doi.org/10.1007/s10964-018-0831-8 


Sandoval-Hernandez, A., Isac, 


Cham, Switze 


Schulz, W., Ainley, J., & Frai 
ternational Association for th 
es/2019-04/ICCS_2009_Technical_ 


In 
fi 


Shacham, M 
of practice. 


Tor 
A 
Ci 


ney-Purta, 


Schulz, W., & Sibberns, H. 


org/10.1080/14703290903069019 


. & Mira 


rland: Springer. 


201 
tion o 
Rep 
Eds.). (2005 


lon, J. 
e Evaluat 


ort.pdf. 


., & Od-Cohe 
Innovations | 


n, Y. (2009). 
Education a 


J., & Barber, C. H. (2004). Stre 


alysis from the IEA Civic Education Study (CIRCLE Fact Sheet). Center for Informa 
vic Learning and Engagement, University o 


Maryland, 


nal Academies Press. 


rta J. (2018). How journalists and researchers communicate results of 
onal large-scale assessments. Cadmo. An International Journal of Educational Research, 1, 51-65. 
oi.org/10.3280/CAD2018-001007 
of the University of Michigan. (2020). CivicLEADS: Civic learning, engagement, and action data 
.edu/web/civicleads/series/202. 
t, F., Chen, J., & Torney-Purta, J. (2018). Profiles of adolescents’ perceptions of democratic 
influence: The effect of school and community contexts. Journal of Youth 


nda, D. (Eds.). (2018). Teaching tolerance in a globalized world. 


1). ICCS 2009 technical report. Amsterdam, the Netherlands: 
f Educational Achievement (IEA). https://www.iea.nl/sites/default/ 


. IEA Civic Education Study technical report. Amsterdam, the 
etherlands: International Association for the Evaluation of Educational Achievement (IEA). 


Rethinking Ph.D. learning incorporating communities 
d Teaching International, 46(3), 279-292. https://doi. 


gths and weaknesses in U.S. students’ civic knowledge and skills: 


ion and Research on 


College Park. http://circle.tuf 


s.edu/sites/default/ 


files/2019-12/FS_StrengthsWeaknessesinUSStudentsKnowledgeSkills_2007.pdf 
Torney-Purta, J., Barber, C. H., & Richardson, W. (2004). Trust in government-related institutions and 
political engagement among adolescents in six countries. Acta Politica, 39(4), 380-406. https://doi. 


org/10.1057/palgrave.ap.5500080 


JOINING AN INTERNATIONAL COMMUNITY OF PRACTICE 203 


orney-Purta, J., Barber, C. H., & Wilkenfeld, B. (2007). Latino adolescents’ civic development in the 
United States: Research results from the IEA Civic Education Study. Journal of Youth and Adolescence, 
36(3), 111-126. https://doi.org/10.1007/s10964-006-9121-y 

orney-Purta, J., Lehmann, R., Oswald, H., & Schulz, W. (2001). Citizenship and education in twenty-eight 
countries: Civic knowledge and engagement at age 14. Amsterdam, the Netherlands: International Association 
for the Evaluation of Educational Achievement (IEA). 


orney-Purta, J., Richardson, W., & Barber, C. H. (2005). Teachers’ experience and sense of confidence 


in relation to students' civic understanding and engagement across countries. International Journal of 
Citizenship and Teacher Education, 1(1), 32-57. http://www.citized.info/pdf/ejournal/vol_1_no_1.pdf 


orney-Purta, J., Schwille, J., £ Amadeo, J. (Eds.). (1999). Civic education across countries: Twenty-four 
national case studies from the IEA Civic Education Project. Amsterdam, the Netherlands: International 
Association for the Evaluation of Educational Achievement (IEA). 


Torney-Purta, J., Wilkenfeld, B., & Barber, C. (2008). How adolescents in twenty-seven countries 
understand, support, and practice human rights. Journal of Social Issues, 64(4), 857-880. https://doi. 
org/10.111/j.1540-4560.2008.00592.x 


Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International 
License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution 
and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a 
link to the Creative Commons license and indicate if changes were made. 

The images or other third party material in this chapter are included in the chapter’s Creative Commons license, unless indicated 
otherwise in a credit line to the material. If material is not included in the chapter’s Creative Commons license and your intended use 
is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright 
holder. 


CHAPTER 18: 


IEA Civic Education Studies in Latin America: Paths 
of Influence and Critique in Policy and Research’ 


Cristidn Cox 


Abstract For the last two decades the international civic education studies of | 
a small group of Latin American countries. The results, in terms of learning outcomes in 
nowledge of their 14-year-old students, as well as the patterns of their attitudes and dispositi 
and coexistence, have been compared to other regions of 
international large-scale assessment to 
in the region is the purpose of this chapter, which 
ry participation. A second section describes the genesis 
of a Latin American module for assessing region-specific civic knowledge and attitudes, u 
the 2009 and 2016 cycles of IEA's Internationa 
CCS). Its relevance and potential are discussed. Parts three and four describe the evolution of 
the influence of IEA civic studies upon both the policy 


regarding political participation 
the world. 
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nature of the political socialization that the school experience typically produces in the region 
and how this replicates or interrupts larger institutional and cultural dynamics embedded in 
differing national political contexts. 
Cc 


For the last two decades a small group of Latin American countries has joined the internationa 


vic education studies of IEA. The learning outcomes in civic knowledge of their 14-year-old 


students, as well as patterns of their attitudes and dispositions regarding political participation 
and coexistence, have been compared to the larger canvas that contains other regions of the 
world. Rationales for this participation, and the nature of the influences these studies have had 
on the policy and research fields of participating countries are discussed here. Examining the 
contribution of this type of international large-scale assessment to citizenship education and 
its renewal in the region is the purpose of this chapter. 


| shall first characterize Latin American countries’ participation in the studies, identifying patterns 
in the political and institutional contexts that favor participation. This includes discussing why only 
four countries, Colombia, Chile, Dominican Republic, and Mexico (out of 19 in the region), have 
participated in two or more studies. In a second section | will describe the genesis of the Latin 
American module assessing region-specific civic knowledge and attitudes in the International Civic 
and Citizenship Education Study (ICCS) 2009 and ICCS 2016. Its development involved a process 
of inter-institutional as well as academic and expert cooperation that bridged the north/south 
divide. Then | will refer to features of the evolution of the influence of IEA civic studies upon the 
region's policymakers and researchers. In a concluding section, | will bring together the descriptive 
and analytical threads. In particular | will discuss the potential for future developments in the 
relationships between IEA studies and the enhancement of Latin American schools’ contribution 
to democracy. As a cross-cutting theme | will put forward possibilities for the use of international 
large-scale assessment studies (ILSAs) by national policymakers and other stakeholders to do 
more than “scandalize” or “glorify” national performances (Steiner-Khamsi 2012). 


The Latin American Region’s Participation in Civic and Citizenship 
Studies 


Latin American countries’ participation in ILSAs started in the last third of the 1990s, when 
these studies became an option for policymakers, and when their countries’ educational agendas 
initiated a turn from coverage and student enrollment to quality and equity challenges. Only 
two countries participated in CIVED 1999, Colombia and Chile, revealing an early interest that 
remained, as they participated in ICCS 2009 and 2016. Together with Mexico and Dominican 
Republic, which participated in both cycles of ICCS, these are the only countries of the region 
to have participated more than once in IEA’s sequence of civic studies. Guatemala and Paraguay 
participated only in ICCS 2009, and Peru only in ICCS 2016, thus composing the seven nationa 


educational systems of the region whose participation will be discussed. 


Average performance on the civic knowledge test across the countries that participated in 
ICCS 2009 ranged from 380 to 483 scale points (international average 500); with a significant 
improvement in the results of both Colombia and Mexico, practically the same range obtained in 
ICCS 2016 (380 to 482 scale points), whilst the international average increased to 517 (Table 1). 


Latin American education does not fare well in test results from international studies. Result 
in civic knowledge have consistently been well below the international average, positioning th 
countries of the region at the bottom of the rankings. 


un 


O 


This may be important in the politics of decision making about participation of Latin American 
countries. That is, the public nature of the results is a potential source of “embarrassment and 
humiliation” (Kamens and Benavot 2012). To this needs to be added the more contested nature 
of civic knowledge compared to language and mathematics. In many Latin America countries’ 
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Table 1: Latin America country averages for civic knowledge in ICCS 2009 and 2016. 


Civic Knowledge 


ICCS 2009 ICCS 2016 Differences 
2016-2009 
Chile 483 482 -1 
Colombia 462 482 + 20 (*) 
exico 452 467 +15 (*) 
Peru = 438 $ 
Guatemala 435 — i 
Paraguay 424 = - 
Dominican Republic 380 380 0 
Latin American ICCS average 439 450 +11 
nternational ICCS average 500 517 +17 


Sources Schulz et al. (2011), ICCS 2009 Latin American report, Table 3.8; Schulz et al. (2018), ICCS international report, Table 3.11. 
Notes (*) Statistically significant at 0.05 level. 
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The IADB, in its turn, contributed to the setting-up and development of a consortium of 
countries interested in evaluating citizenship education, the Sistema Regional de Evaluaciön 
de Competencias Ciudadanas (Regional System for the Development and Evaluation of Citizenship 
Competencies) (SREDECC), which was instrumental for the elaboration of the Latin American 
module of ICCS 2009. Further, the IADB helped fund the participation of some countries in this 
study. | shall return to this mediating role of multilateral institutions in the concluding section. 


In some sense the various conditions referred in this section, can be thought of as constituting 
emergent properties that set the context and capacities for the countries’ participation. 


ICCS Latin American Module: Striving for Regional Relevance 


t is a major difference with other ILSAs that IEA’s civic studies include regional-specific 
instruments or modules. The Latin American module was generated through extensive and 
effective cooperation between ICCS’s central team and academics (along with ministries’ 
personnel) from participating countries of the region. This was in the framework of a larger 
initiative to enhance civic education in the region supported both by the IADB and the OAS. 
The opportunity to include region-specific topics and issues in the evaluation framework and 
instruments decisively increased the relevance as well as interest in and impact of the studies. The 
overall process is a clear case of an emergent result, where actors and contingencies converged 
upon something not planned or visualized in the initial definitions of participants (Torney-Purta 
and Amadeo 2015; Pritchett 2015). 


The threads of this emergent result involved individuals and institutions from north and south. 
In the early 2000s Fernando Reimers, a Harvard University professor from Venezuela, who 
had been publishing on the need to prioritize civic education in the region (Reimers 2004), 
became aware of the CIVED study and invited Judith Torney-Purta to make a presentation 
about Hispanic students’ civic preparation in the United States. This was the starting point for a 
closer examination of results from Chile and Colombia, the only Latin American countries that 
had participated in CIVED. Reimers presented his view that schooling in this region was doing a 
poor job regarding civic education to sector leaders in education and development at the IADB. 
He argued that the IADB could make a significant contribution by funding a “regional public 
good” consisting of an observatory of effective programs of citizenship formation to facilitate 
exchange of best practices among countries. Individual country teams could request support 
from the IADB for such a "regional public good.” The Bank in 2005 put this at the center of 
the agenda of the regional meeting of education ministers (Trinidad and Tobago, August 2005), 
supported by OAS. It provided them with a document that offered a conceptual framework and 
evidence that justified a regional project for citizenship education’s enhancement (Cox et al. 
2005). The initiative received almost unanimous support and Colombia and Mexico proposed 
the project. A center was set up in Bogota, Colombia: the SREDECC. Two years after its creation 
while debating its larger priorities, the center decided that member countries’ participation in 
the upcoming ICCS 2009 was important. Concurrently, OAS supported a survey on curricular 
and teacher-related features of citizenship covering 25 Latin American countries (Amadeo and 
Zepeda 2008). 


The SREDECC convoked a regional expert group, coordinated by Fernando Reimers and 
consisting of consultants from Colombia (Enrique Chaux), Chile (Cristian Cox), Dominican Republic 
(Josefina Zaiter), Guatemala (Otto Rivera), Mexico (Amelia Molina), and Paraguay (Lilian Soto), 
who agreed upon a framework relevant for the region. The ICCS team had as its international 
study director Wolfram Schulz, who is fluent in Spanish and had done socio-political research in 
Latin America. With the contribution of Eugenio Gonzalez from the Educational Testing Service 
(ETS), a test and questionnaire were developed that gathered data on region-specific aspects of 
civics and citizenship fitting within the framework of the international test and questionnaires. 
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An examination of conceptual relationships between the framework developed by the Latin 
American group and the ICCS 2009 framework revealed differences in concepts and emphases 
(Cox 2010; Schulz et al. 2011). These were embedded in Latin American countries’ recent 
political history as well as resulting from deeper and longer-term cultural features of the region. 
An example of the first is the salience of issues related to the history of authoritarian governments 
and the transition from dictatorial regimes to democracy, and also a less active concept of citizen 
participation than the one at the core of the international framework. An example of the second, 
was the Latin American group's restricted conceptualization of civil society, which did not include 
the economy or business organizations (see Oxhorn 2011). 


After refining the common material to be measured from the ICCS assessment framework, the 
main issues assessed by the regional instrument were students’: 


e sense of Latin American identity; 

e knowledge about and attitudes toward authoritarian government and dictatorship; 

e knowledge about and attitudes toward corrupt practices in government and/or public ser- 
vices; 

e knowledge about discrimination and their attitudes toward diversity; and 

e knowledge about and attitudes toward the presence of violence in society (Schulz et al. 
2011, p. 15). 


In ICCS 2016, the regional student questionnaire covered most of these region-specific aspects, 
except for the “sense of Latin American identity” (Schulz et al. 2018). | believe this inadvertently 
removed from the assessment module the only dimension which was positive rather than 
negative about politics and citizenship in the region. The module concentrated on fundamental 
democratic deficits—dictatorships, corruption, violence, law disobedience. In my view this needs 
to be complemented with bases for construction of a democratic culture through schooling. 
Comparative analysis of curricula reveals three relevant dimensions of this culture receive scant 
or no attention: political tolerance, the common good in unequal societies, and the centrality of 
elections and voting. (Cox et al. 2014). To this it should be added that dictatorships or the risk 
of their return are no longer the focal political issue in the region. Instead it is the complex mix 
of populism, weak institutions, and a crisis or malaise in representation (Oxhorn 2011; Joignant 
et al. 2017; Bargsted et al. 2017; Mainwaring and Pérez-Liñán 2013). 


The Latin American regional module has made a key critical contribution up to this point. Now it 
needs to move toward including positive dimensions of educational renewal relevant for current 
political times and contexts. 


Paths of Influence on Policymaking: How Context Rules 


The general question about how CIVED and ICCS studies have influenced the education policy 
field of participating countries in Latin America may be fruitfully approached with categories 
from the policy transfer and knowledge utilization literatures (Dolowitz and Marsh 2000; 
Dolowitz 2007; Stone 2004). A driving notion in analyses of policy transfer from one national or 
international context to another, apart from cases “in which one sees a photocopy emerge from 
the process” (Dolowitz 2007, p. 41), is that knowledge mobilized from one context to another is 
equivalent to knowledge transformed. This takes place through processes of selection, filtering, 
mixing, and translation shaped by political, institutional, ideological, circumstantial, and personal 
factors. What is borrowed will generally undergo substantial modifications. How hybridization, 
adoption, and mutation occur is key. 


There has been no systematic research on how the IEA studies—their conceptual frameworks, 
instruments, and results—have affected Latin American countries’ policy-fields and their decision- 
making regarding curriculum, evaluation, and teacher policies. Thus, questions about knowledge 
transfer and re-contextualization processes cannot be answered systematically. Instead, | will 
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refer to key features of these processes for the Chilean case, where | have first-hand experience, 


and | will discuss some features of the Colombian and Mexica 
aspects of the studies’ impact on policymaking across these three national cases. 
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assessments applied to the whole cohort of students of years 5 and 9, include a citizenship 
thinking (pensamiento ciudadano) test, and a civic actions and attitudes test. This distinction and 
its components is clearly derived from the ICCS 2009 evaluative framework. The influence of 
ICCS 2009 is especially visible in the citizenship thinking test. Its four dimensions—knowledge, 
argumentation, multi-perspectivism, systemic thinking—can be seen as elaborations of ICCS 
2009's cognitive domains—knowing, and reasoning and analyzing (Schulz et al. 2008). In the 
actions and attitudes test the dimension of participation and democratic responsibility is mainly 
framed in terms that replicate the three issues that structure the Latin American regional module 
of ICCS 2009: not complying with the law, corruption, and support for authoritarian government. 
On the whole this picture gives credence to the notions of knowledge-borrowing and active 
re-contextualizing. This was conveyed by a judgment of an expert at ICFES: “In fact, our test 
of citizenship competences has similar components, at least in structure, to ICCS” (C. Lopera, 
personal communication, February 3, 2019).* 


In the case of Mexico, an analysis produced for SREDECC examined the presence/absence of 
ICCS 2009 categories in the curricula of the six Latin American participating countries (Cox 
2010); this prompted Secretaria de Educación Pública to recognize that critical issues (such as 
voting and the judiciary), were not receiving adequate attention in the civics and ethics subject 
of 2006, which led to its redefinition in the curriculum of 2011.4 However, there are no traces of 
ICCS framework’s influence on the new re-adjustment of the area decreed in 2016 for primary 
education and 2017 for secondary education (Secretaria de Educación Pública 2017), nor in the 
evaluative studies carried out after 2013. (S. Conde, personal communication, February 2, 2019). 


Two other dimensions should be mentioned. First, there may be more direct and specific effects 
than this long-route of curriculum and assessment traced in Chile. There is an effect on the 
political level of policymaking in the public arena where government, legislatures, and media 
interact, particularly in relation to law-making processes (Kingdon 2003). President of Chile, 
ichelle Bachelet (in her second term in office, 2014-2018), used the poor civic knowledge 
results of Chilean students in ICCS 2009, to argue for a law requiring every school in the country 
to implement a plan for citizenship formation.? This was a clear case of direct political use of the 
information produced by ICCS. The law was passed in January 2016. Secondly, there is another 
type of influence of the international studies, which is indirectly related to the policymaking 
process. This is the capacity-building process (Grindle and Thomas 1991). For every study, there 
has been a national expert team in the ministries and associated agencies whose capacities have 
been enriched (Cox and Meckes 2016; Cariola et al. 2011). 


The arc of policy influence of the IEA civic studies in different countries converges on the 
curriculum and assessment areas. It is clear that context determines what gets selected and 
reorganized for appropriation and integration into schooling in different countries. At the same 
time, every national context is, to some extent, modified by its exposure to the new knowledge 
from the studies. 


Underlying the interrelations between national context and new knowledge there is, in my view, 
a fundamental outcome about what ILSAs in Latin America accomplishes. When a country’s 
educational authorities agree to administer international instruments that make the national 
education system accountable, it establishes a new public view-point on that system. Policymakers 
and public must grapple with the evidence presented by the performances of other national 
systems and this allows discovering and discussing if and how their country is advancing or not. 


3 Carolina Lopera, ex-coordinator of the citizenship competences team, (responsible for the application of both SABER 
and ICCS tests) at ICFES. 

4 Country overview. Report of Mexico to ICCS 2016. 

5 President Bachelet message N° 312-363 to the President of the Chamber of Deputies, initiating a law mandating a 
plan for citizenship education in every school. Santiago, May 5, 2015. 
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| interpret this as an all-embracing but non-specific influence of the studies on policymaking 
in education in the participating countries. Indeed, a potentially clearer vision by all concerned 
parties about the country’s education via international comparison may be seen as an increase 
in reflexivity of the policy-field. This takes place through dialogue and the raising of questions 
(Heyneman and Lee 2012; Reich 1988; Rosanvallon 2010). 


Influences Upon Research: The Emergence of a Field 


At the beginning, scholarly research on | 


EAS civic studies’ data was conducted by the same 


teams that generated the studies; two decades after CIVED, there is a community of Latin 
American scholars doing high-level research on the conceptual frameworks and data from the 
studies. | shall briefly describe the landmarks in this evolution and refer the types of research 
and intergenerational features of this emergent field. Torney-Purta and Amadeo (2015) phrased 


ina 


Col 


Am 


focused on similarities and differences in 
and on the views of teachers. A decade later, t 


variety of contexts” (p. 54). 


Research specific to Latin American students’ 
have started with the secondary analysis of C 
Torney-Purta and Amadeo (2004). As men 


it this way: “political socialization and civic education as a field of research in Latin America can be 
thought of as emerging over time as a complex system through a process of multiple influences 


civic knowledge and attitudes may be said to 
IVED 1999 results carried out for the OAS by 


ombia and compared them with results from 


tioned, their study reviewed results from Chile and 


the United States and Portugal. The publication 


erica region in ICCS 2009 (Chile, Colombia, 
and Paraguay) resulted in a wealth of evidence 
research on civic and citizenship educat 


the civic-related views and knowledge of students, 


he participation of six countries from the Latin 
the Dominican Republic, Guatemala, Mexico, 
that could be examined in the emergent field of 


tion, decisively moving forward to examine questions, 
methodologies, and results. As the ICCS 2016 Latin American report summarizes: 


“Today, researchers in this area are increasingly conducting more sophisticated multilevel and/ 


or multivariate analyses. They are also invest 


tigating patterns of civic knowledge and attitudes 


in quite diverse national contexts (both regional and global) and exploring associations between 


these patterns and socioeconomic and hom 


e background variables as well as key features of 


countries’ educational contexts, such as school resources, curricula, and pedagogical approaches” 


(Schulz et al. 2018, p.10). 


Over thirty papers and two books based on ICCS 2009 results have been produced in the 
last five years by researchers from Chile, Mexico, and Colombia (see Sandoval-Hernandez 


and 


iranda chapter). There are clearly identifiable groups and lines of research which are 


developing relevant knowledge in the three countries, with increasing cross-regional initiatives. 
Additionally, credit should be given to Latin American researchers who moved to Europe and, 
through work in international organizations (including IEA) became involved in secondary analysis 
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of both students’ civic knowledge and perceptions of an open classroom climate in fostering 
expected political participation. Using a series of multilevel models they found support for 
the influence of students’ socioeconomic background on expected electoral participation. 
Furthermore, civic knowledge and classroom climate showed a positive and similar influence 
on students’ expected participation. However, classroom climate appeared less affected by 
students’ background than civic knowledge, opening a discussion about strategies that could 
be prioritized when aiming to mitigate political participation gaps. 


Asecond type of research is qualitative and has the preparation of teachers as its prime object. 
The key points are conceptual: how does the framework of ICCS covering citizenship and 
democracy compare with the definitions in the curricula of Latin American countries and the 
contents of teacher education programs? Key findings are that the curricula of the six countries 
that participated in ICCS 2009 disproportionately emphasize peaceful coexistence or the civil 
dimension of “living with others,” over the civic (political) one. Voting receives intriguingly scant 
attention (Cox et al. 2014; Riquelme 2019). This imbalance is replicated in teacher education 
programs, where the thematic categories most commonly omitted are those related to the 
political dimensions of citizenship (OREALC-UNESCO 2017). These characteristics of curricula 
have received little attention and have implications for policy. 


At the basis of these broad lines of development of the “emergent field” of Latin American 
studies of citizenship education are capacity, networking, and cooperation-building processes 
that consistently cross the north/south classification in new ways. Research on Latin America is 
now mainly based in the region, and its volume and quality is consistently increasing. This would 
not have happened without the openness to cooperation and capacity-building initiatives of the 
civic studies’ leadership and IEA's technical core groups. From this nucleus of cooperation, the 
features of the emergent field developed. It has increasingly rich synergies across countries and 
the north/south gap. There are three generations of researchers at work—senior, mid, and early- 
career. The resulting accumulation of knowledge and expertise has possibilities for projection 
in policy and to support practice. The importance of this last aspect cannot be overstated: the 
use-potential of any international study is crucially dependent on national capacities to interpret 
its conceptualizations and data and go deeper into their implications for practice. That there is 
now an international field of Latin American scholars and researchers in the area cognizant of 
the studies’ generation, methods and results, strongly suggests that those capacities now exist 
and are further developing. 


Concluding Remarks 


What the countries’ educational discourse and practices achieve by their participation in IEA's 
civic and citizenship studies varies according to national contexts. This applies equally to the 
policy and the research fields. The same instruments and information lead to a range of different 
broader outcomes that accord with national, political, and institutional factors. A generation of 
early career scholars are taking interest. But what is the essence of what gets transferred and 
re-contextualized in the processes? This question lies at the center of what defined CIVED and 
CCS studies—their design and conceptual contents, their implementation, and how their results 
have been communicated. 


propose that what gets mobilized and exchanged is a conceptualization of democratic citizenship 
nd its principles, institutions, and defining processes. A further issue is how these are known or 
not, and believed or not, by the new generation in stunningly diverse school settings. How has 
this conceptualization been arrived at? What is the value of examining the interplay between 
the knowledge and attitudes of the young in each country’s policy and research fields? These 
are questions that connect with key distinctive features of the civic and citizenship studies of 
EA and their potential influence. 


ied) 
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What the studies measure can be seen as the distilled democratic tradition and its interpretation 
in post-modernity. This interpretation has initially been conceptualized and organized by the 
studies’ leaders and the Project Advisory Committees (PAC). They are then adjusted and refined 
by exchanges with representatives from the participating countries. In my experience in two 
cycles of PAC, a major motivation has been to arrive at a construct that is as representative 
and balanced as possible. It is a difficult articulation process aiming to identify the common 
threads at the core of the democratic tradition. This effort looks back to the discourses about 
its core. It also looks to the present world of politics and its dynamism that contains many 
puzzling aspects. What should be selected and prioritized? Which trends should be recognized 
and included? Of course, the answers to these questions inevitably reflect the socio-cultural, 
institutional, and personal limits of those who participate in their construction. The study has a 
“democratic first-world” imprint inseparable from the studies’ original conceptualization in the 
academic fields of the United States, Europe, and Australia. It also has features of a common, 
shared vision about the democratic ideal. In other words, it contains a core that nowadays is 
deemed crucial for schooling to communicate in our increasingly common as well as increasingly 
unequal world. | consider these features to be attributable to the international and intercultural 
nature of the civic studies’ decision-making bodies along with their openness to the input of the 
participating countries. They have found ways to construct regional instruments that search for 
contextual relevance. | consider this of utmost importance and value, as the studies incarnate 
both horizontality and openness in the interpretation of the democratic tradition, which is a 
condition for their legitimacy. 


Seen from the viewpoint of any single country, each study raises a mirror that reflects both the 
core of the democratic tradition in its contemporary international interpretation and how its young 
generation understands and appreciates it. Additionally, both the assessment framework and the 
results produced by each study's instruments, reflected in that mirror, have the potential to provide 
8 
8 
de 


a rich basis for reflexivity in the policy, research, and practice fields. | see the studies offerin 
the national policy and research arenas (and the schooling systems) the possibility of puzzlin 
over and learning from comparative knowledge that is intrinsically empowering (Freeman 2008 


f the provision of a particularly rich and open-ended basis for reflexivity is at the core of th 
contribution of the civic studies, how could their influence be enhanced in Latin America? Th 
following suggestions merit consideration. 


D 


D 


The international public good that the studies offer could be an advantage to more countries 
in the region: the expansion of participation should be a serious goal. From this perspective 
the mediating role played in the past by multilateral agencies like OAS and the IADB, merit 
consideration. They could bridge over cultural and ideological factors hindering participation of 
some countries and provide political justification for participation by others. 


The Latin American regional module of questions could play a role in the effort to expand country 
participation in the region. An effort could be made to update it by more fully incorporating 
researchers and educators from participating countries in the process of its development. 


n the long run, probably the most secure basis for optimizing the studies in the countries of 
this region is the strengthening of internal research capacities. Policies would have a different 
basis if there were capacities among scholars across generations in more countries to utilize the 
reflexivity potential provided by the studies and their freely available data. Governments would 
feel less doubtful about embarking on the “international-comparison risks” if they could count 
on a research field able to provide explanations after results appears. Interest could be fostered 
in the concepts, the data and the public discussion potential of the comparative evidence. How 
to connect the studies’ products and circuits of communication not only with governments and 
their ministries, but consistently with universities and their research leaders is worth pursuing. 
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CHAPTER 19: 


The Contribution of the IEA Civic and Citizenship 
Education Studies to Educational Research and 
Policy in Europe 


Maria Magdalena Isac 


Abstract The main objective of this chapter is to describe the contribution of the IEA civic 
and citizenship education studies—Civic Education Study (CIVED) and International Civic and 
Citizenship Education Study (ICCS)—to educational research and policy in the European context 
during the last 20 years. To this end, the chapter begins by briefly introducing the major education 
research and policy priority areas regarding civic and citizenship education in Europe and 
provides a brief account of the participation of European countries in the IEA studies. Then, the 
contribution of IEA civic and citizenship education studies is illustrated by highlighting research 
themes, topics, and findings of specific prominence and relevance in Europe that were enabled 
by such data. Finally, there is a reflection on potential avenues for further research as well as 
for increasing the impact of the IEA studies in the European context. 


Introduction 


In 2007, | began my doctoral research in civic and citizenship education at the University of 
Groningen in the Netherlands as a researcher in the team responsible for coordinating the 
International Association for the Evaluation of Educational Achievement (IEA) International Civic 
and Citizenship Education Study (ICCS) 2009; | assisted in the preparation of the national reports. 
This endeavor introduced me to the world of the IEA international civic and citizenship education 
studies. Since then, | have been part of a vibrant international community of researchers working 
independently but enthusiastically on comparative research in civic and citizenship education 
making use of IEA data. Later | worked for the European Commission’s Joint Research Centre, 
and | was involved in the coordination of the European Commission’s participation in the ICCS 
2016 study. Over these years, | have witnessed rapid development of the impact of the ICCS 
studies on the field of citizenship education in Europe and | am taking this opportunity to share 
my observations from my current vantage point on a university faculty. 


n> 


n this chapter, | will illustrate how IEA civic and citizenship education studies (CIVED 1999, ICCS 
2009, and ICCS 2016) stimulated a great deal of research connected to topics of interest for 
European educational policy. To this end, | begin by briefly describing the context and the main 
education research and policy priority areas regarding civic and citizenship education in Europe 
and show how the participation of European countries in IEA civic and citizenship studies was 
intertwined with growing interest in civic and citizenship education in Europe. Then, drawing 
on extant research findings, | highlight the main research themes that could be addressed by 
secondary analysis of IEA studies’ data leading to findings that are informative for scholarly 
research, as well as for policy and practice of civic and citizenship education in the European 
context. Lastly, | reflect on opportunities for further research as well as for increasing the impact 
of the IEA studies in the European context. 
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The European Educational Policy Context and the IEA Civic and 
Citizenship Education Studies 
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Figure 1: European countries by frequency of participation to IEA civic and citizenship education studies: 
CIVED 1999, ICCS 2009, ICCS 2016 


Participation 
0 


© 2021 Mapbox O OpenStreetMap (0) mapbox 


Source: Own elaboration based on participants in CIVED 1999, ICCS 2009, and ICCS 2016. See: https://www.iea.nl/index.php/ 
studies; The map was created using Mapbox and OpenStreetMap and their data sources. See: https://www.mapbox.com/about/ 
maps/ and http://www.openstreetmap.org/copyright 


as European citizenship and identity, attitudes toward the free movement of citizens in Europe, 
attitudes toward the future of Europe, and the role of EU cooperation in addressing political 
and social problems. 
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In recent years, themes discussed in the new strategic framework for European cooperation in 
education and training 2030, in a recent competency framework from the Council of Europe 
(Barrett et al. 2016), and in the research-based recommendations from the European Parliament 
(Veugelers et al. 2017) have highlighted several relevant topics. Secondary analysis of data 
collected by the IEAICCS studies could be directed to these issues: developing media literacy 
and critical thinking, preventing radicalization in youth, preventing school violence, teaching 
common European values, promoting civic and intercultural competences, and encouraging 
practices of inclusion in schools (especially in this era of enhanced migration) (see also European 
Council 2015). A handbook chapter on civic education authored by three European researchers 
(Carretero et al. 2016) has provided suggestions about taking educational and social contexts 
into account in the examination of issues such as these. 


Established and Recent Themes in the European Research Landscape 
Making Use of IEA Civic and Citizenship Education Studies 


The educational policy initiatives and priority areas were accompanied by prolific empirical 
research on civic and citizenship education making use of IEA data. Indeed, the body of 
comparative research including European countries and based on data from the IEA civic and 
citizenship education studies has been growing considerably, sometimes with implicit connections 
to European issues. For example, a recent summary of research (Knowles et al. 2018) identified 
over 100 published articles reporting secondary analysis of CIVED 1999 and ICCS 2009 data. A 
arge proportion of these publications are international comparative analyses that included several 
European countries, but some also report analyses focused on individual European countries. 
ost use data from the international instruments, and a few use data from the European regional 
module. A partially overlapping list of publications with a few more recent entries can be found 
at the website of the CivicLEADS Project (Regents of the University of Michigan 2020). Within 
and across countries groups of collaborating researchers are coalescing around common interests 
in the dataset as a whole. 


The contents of these publications to a large extent address policymakers’ needs for comparative 
data on outcomes and processes of citizenship education: understanding what appears to be 
successful in European school systems for the promotion of civic and citizenship competences 
i.e., enhancing the knowledge of democracy, trust in democratic institutions, citizenship efficacy, 
civic engagement, acceptance of those who come from diverse backgrounds). Indeed, existing 
research, recently enriched by empirical articles reporting secondary analyses of ICCS 2016 data, 
falls largely into two categories: a) comparative studies focused on citizenship competences 
in youth, and b) comparative and country-specific studies focused on structural and learning 
approaches to citizenship education and their potential impact on youth citizenship competences. 


n what follows, | give a brief overview of topics approached within these two research themes 
that have been addressed by secondary data analysis of IEA studies. Then, | point out some 
recent conceptual and methodological developments, which | illustrate by a few (by no means 
exhaustive) examples of empirical studies. 


Studies Focused on Citizenship Competences in Youth 


To give an overview, several studies using data from the IEA civic and citizenship education 
studies were dedicated to defining and then comparing citizenship competences in European 
youth. Reflecting both societal concerns and policy initiatives, some projects created composite or 
summary measures of citizenship competences (Hoskins et al. 2011). Some other studies focused 
on comparing attitudinal measures such as young people’s institutional trust, voting intentions, 
and their attitudes toward support for immigrants’ rights and gender equality (Barber and Ross 
2018; Isac et al. 2019; Malak-Minkiewicz 2007; Miranda and Castillo 2018; Mirazchiyski et al. 
2014; Torney-Purta and Barber 2011). Moreover, other research addressed comparisons of 
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citizenship norms or perceptions of “good citizenship” behaviors among youth (Hooghe and Oser 
2015; Hooghe et al. 2016). There has also been discussion and analysis of European identity 
and cosmopolitan attitudes (Keating 2016; Toots and Lauri 2015; Verhaegen et al. 2013). 


In recent years, these analyses have addressed a number of conceptual and methodological topics. 
One of these is the increased concern about investigating and documenting the cross-cultural 
comparability of instruments measuring young people’s endorsement of equal rights for different 
groups in society and the comparison of these attitudes across countries. Indeed, a number of 
recent publications based on CIVED 1999 and ICCS 2009 and 2016 data have been dedicated 
to understanding inter-European and international differences in young people's attitudes toward 
equal rights for immigrants, a topic of particular interest in the European context (Isac et al. 2019; 
iranda and Castillo 2018; Munck et al. 2017). These studies demonstrated that it is important 
to assess cross-cultural comparability (or measurement invariance) when comparing attitudinal 
measures across countries and over time. The IEA studies focus considerable attention on the 
validity and comparability of measurement instruments, but cultural, linguistic, and geographic 
differences do exist and should be the explicit focus of secondary analysis of ICCS data (He and 
Van de Vijver 2013; Rutkowski and Svetina 2017). Here it is important to note that their findings 
indicated that European young people tend to be, on average, supportive of immigrants’ rights. 
owever, these attitudes show high variability within countries. For example, in ICCS 2016 
Swedish students have both the highest average scores in Europe and the widest gap between 
the average scores of the students in the 5th and 95th percentile (see Isac et al. 2019). 


oreover, attitudinal differences are associated with individual characteristics such as the 
student's civic knowledge, socioeconomic status, immigration background, and gender. In 
particular, students of lower socioeconomic status, native-born students, students with lower 
evels of civic knowledge, and boys are less likely to endorse immigrants’ rights (Sandoval- 
ernandez et al. 2018). 


n parallel, another topic and method of analysis has emerged in recent research. More specifically, 
in order to demonstrate the complexity of interconnections among attitudinal measures, some 
researchers have moved away from variable-centered analyses comparing group means to instead 
identify profiles of young people’s attitudes using person-centered statistical approaches (Hooghe 
and Oser 2015; Hooghe et al. 2016; Reichert 2016; Reichert et al. 2018; Torney-Purta and Barber 
2011). This approach applies in particular to the topic of young people's citizenship norms. For 
example, guided by Dalton’s theoretical work and studies of adults on norms of civic duty (2008), 
researchers have used IEA data and employed latent class analysis to identify groups of students 
with different perceptions of “good citizenship” behaviors (Hooghe and Oser 2015; Hooghe et 
al. 2016). Consistent with Dalton’s distinction, their results indicate that a large proportion of 
young people in a range of democracies (38 countries in ICCS 2009) express either “engaged 
citizenship” norms (highly endorsing the protection of human rights and community involvement, 
while downplaying the importance of traditional duty-based political participation) or “duty- 
based” citizenship norms (highly endorsing traditional political participation). Consistent with 
the findings of Hooghe et al. (2006), ongoing work with ICCS 2016 data (Treviño et al. 2021, in 
press) further confirms these findings by identifying five types or profiles of citizenship norms. 
These are comprehensive, socially engaged, duty-based, monitorial, and anomic. They find that 
across the European countries participating in ICCS 2016 large proportions of young people can 
be regarded as involved citizens who tend to hold holistic visions of good citizenship that are 
not limited to the fulfillment of duties but incorporate aspects of respect for the environment 
and human rights into their behaviors. 
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Studies Focused on the Role of Teaching and Learning Approaches and Structural School 


Characteristics in Citizenship Education 


Teaching and learning approaches to citizenship education and their association with student 


citizenship competences have become a prevalent theme in country-specific and comparative 
studies involving European countries and using IEA data. This research has particularly emphasized 
the important role of school environments in which high quality dialogue and debate on political 
and social issues are encouraged, where inclusive and mutually respectful teacher-student 
and student-student relationships are fostered and, where students are given opportunities to 


partic 
partic 


pate actively in extracurricular activities (e.g., volunteering 
pating in the school’s democratic structures. 


in the community) as well as 


Open classroom climate and its links to students’ citizenship competences is one of the most 
frequently studied topics. A set of items measuring an open classroom climate—that is a classroom 
where participation and respectful discussion is encouraged—was first introduced in the IEA's 


civic education studies in the 1970s (Torney et al. 1975). 


evidence for the positive contribution of such classr 


ac et al. 2011), support for the norms of conven 


identify, by means of multiple regression analysis 


of schooling as relevant predictors in a majority of 


Driven by interest in structural factors that could p 
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findings (largely confirmed by subsequent research with ICCS data) pointed to three aspects 
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difference at their school, and students’ membership on the student council. 


Extensive analyses have provided 


oom experien 


tiona 


ce. Over time and contexts, this 
teaching and learning approach has been found to be positively related to a variety of citizenship 
competences in the European context and internationally. Anumber of cross-country and single 
country studies analyzed the role of open, participatory, and respectful discussion climate in 
European countries. These studies found an association between such a climate and several 
aspects of citizenship competence such as civic knowledge (Alivernini and Manganelli 2011; 
S | and social-movement citizenship (Isac 
et al. 2014; Knowles and McCafferty-Wright 2015), political efficacy and political participation 
Ekman and Zetterberg 2011; Quintelier and Hooghe 2013), an 
for immigrants, ethnic minorities, and women (Isac et al. 2012; Sa 
This line of work can be linked to a seminal study reporting the analysis of the CIV 
within a group of European countries (i.e., Bulgaria, Czech Republic, Denmark, England, Germany, 
taly, Norway, Sweden, and Switzerland) (Torney-Purta and Barber 2005). That study aimed to 
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some other studies focused specifically on the 
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Recent Conceptual and Methodological Developments 


Recently, research focused on teaching and learning approaches to citizenship education and 
on structural school characteristics is making notable conceptual and methodological advances, 
which open up new research opportunities. 


First, there is an increased interest in integrating several conceptual frameworks to simultaneously 
study concurrent explanatory mechanisms situated at different levels of analysis such as the 
student, the classroom, the school, and the educational system levels. The importance of this 
approach was recognized in a review of political socialization and civic education research 
by Torney-Purta et al. (2010). This research direction has been facilitated by methodological 
advancements such as multilevel modeling and structural equation modeling, which facilitate 
theory testing with a focus on multiple explanatory mechanisms situated at different levels 
(student, classroom, school, country). In addition, these substantive and methodological 
approaches have been used to examine interactions between factors situated at different levels 
(e.g., interactions between student background characteristics such as gender or socioeconomic 
background and aspects of class or school climate). Furthermore researchers have focused 
on several explanatory variables that can vary in their impact depending on school or country 
contexts. 


Sandoval-Hernåndez et al. (2018), for example, used a framework rooted in ecological systems 
theory and educational effectiveness research to examine factors and conditions that have 
the potential to promote positive attitudes toward the rights of immigrants, ethnic groups, and 
women. This book-length report of analysis commissioned by IEA used data from 38 countries 
participating in ICCS 2009 (of which 26 were European). They examined the impact of severa 
student and school characteristics on student attitudes. In five interconnected empirica 
analyses that acknowledged the complex, hierarchical layers of explanatory mechanisms, the 
authors reported in-depth on a particular topic and level of analysis (e.g., student background 
c 
e 


haracteristics, teaching and learning practices in schools). These findings showed that severa 
xplanatory mechanisms are required to understand the factors that relate to young people’s 
tolerant attitudes. The results suggested the importance of taking into account the dimensiona 
structure of constructs (e.g., the strong positive association between attitudes toward immigrants, 
toward ethnic minorities, and toward women). The findings also pointed to the prominent role 
of background variables—singling out boys, low socioeconomic status students, and students 
with low interest in political and social issues, as the most likely to hold intolerant attitudes 
across countries. Moreover, the results showed once more the important role of democratic 
school cultures and climates that nurture open discussion and encourage free dialogue or critical 
debate. They identified a need for teacher professional development regarding the fostering of 
a classroom climate supportive of the teaching of potentially controversial issues. 


Second, recent research gives attention to the ways in which students’ ratings of the school 
environment are shaped by contextual school characteristics as well as by student background 
characteristics such as gender, being a migrant, or socioeconomic status (Barber et al. 2015; Claes 
et al. 2017; Reichert et al. 2018). For example, Reichert et al. (2018) used latent class analysis 
applied to ICCS 2009 data to investigate profiles of students’ perceptions of their classroom 
and school environment (i.e., whether students have voice in school decisions and whether an 
open classroom climate prevails) in Northern European countries. They identified five distinct 
groups of students (i.e., alienated, indifferent, activist, debater, and communitarian) and found 
that aspects of the school environment were linked with these styles of participation. They found, 
for example, that compared to indifferent students, debaters, activists, and communitarians 
were more likely to be found in schools where teachers acted as role models by engaging in 
school governance. Moreover, Claes et al. (2017) used deliberative democratic theory to frame 
an analysis of how individual student characteristics influence an open climate for discussions 
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enhanced preparation of teachers both prior to service and in service are widely recognized 
across countries. This an area where cross-European collaboration could be encouraged. 


Furthermore, UNESCO's 2030 agenda for sustainable development and global citizenship 
education as well as the new strategic framework for European cooperation in education and 
training 2030 agenda in the field of inclusion and citizenship education could promote relevant 
research training and other opportunities. This is especially important in contexts in which there 
has been a drop in participation (e.g., Eastern European countries). Examining the chapters in 
the first part of this book that describe the meaning and utilization of findings in a number of 
European countries could provide suggestions for collaboration across the region. One might 
also focus on developing networks and partnerships that include researchers across disciplines 
together with those interested in enhancing teacher preparation. Although it is challenging in 
the current political climate, attention could be paid to making the findings relevant for a wider 
range of European countries and further consideration given to mechanisms for translating 
research findings into implications for policy and practice at the national and the regional levels. 


While all these initiatives aim at better exploring the existing data, an alternative and potentially 
fruitful avenue would entail opening a dialogue with IEA project leaders about enriching the data 
collection process to oversample some populations that are currently underrepresented. Such an 
approach would be especially beneficial if it could provide data allowing responses to relevant 
policy issues. For example, the situation of migrant students is becoming an increasing concern 
in many European countries. At the moment the ICCS studies can offer only limited insights 
on such topics given the small proportion of migrant students in most countries’ samples. The 
existence of a policy need for more information could trigger modifications that would allow 
oversampling these groups of students. 


In summary, a large number of European educational systems have taken part in international 
studies of civic and citizenship education such as CIVED 1999, ICCS 2009, and ICCS 2016. Over 
two decades these studies as well as secondary analysis of their data have provided insightful 
and relevant findings for European citizenship education policy initiatives and practices. This 
chapter has highlighted some of the most relevant themes addressed in secondary analyses of 
these data and pointed out topics that could be further explored in future research. 
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CHAPTER 20: 


Asian Students’ Citizenship Values: Exploring 
Theory by Reviewing Secondary Data Analysis 


Kerry J. Kennedy 


Abstract It has been argued that “Asian values” in general and Asian citizenship values in 
particular are distinctive to the region. A range of theoretical literature has advanced this view. 
Scholars have referred to an “Asian modernity,’ reflecting regional citizenship values across 
time and borders. This departs from the largely Western idea of a set of universal democratic 
values that are characteristic across countries and has important implications for citizenship 
education. This chapter summarizes empirical analyses that have used IEA International Civic 
and Citizenship Education Study (ICCS) 2009 data to explore “Asian” citizenship values, their 
extent, and their meaning. The results suggest that diversity rather than uniformity characterizes 
students’ citizenship values in five Asian societies. Within and across these societies there are 
varying levels of endorsement of citizenship values (including traditional values), and support for 
civic engagement. This chapter highlights several ways of thinking about Asian citizenship values 
and suggests an ongoing research agenda to address the diversity that characterizes the region. 


Introduction 


Secondary analysis of data is a powerful tool for informing theoretical perspectives (Smith 2008; 
Hakim 2013). Yet, as Bauer (2009) pointed out, if data is to be linked to theory it is important 
to specify the type of theory. He identifies three types of theory that are broadly sociological 
in nature: “social theory” that is concerned with core concepts that explain how society works; 
“middle range theories” that focus on specific themes that characterize some aspect of society; 
and “theories of society” that try to encapsulate some general aspect of an entire society (p. 
10). Citizenship values reflect this society-wide view since they are often portrayed almost as 
a world view. The idea of “liberal democratic values,” for example, reflects a set of citizenship 
values that are expected to characterize a wide range of democratic societies. 


As helpful as this categorization is, it can break down when applied to a region. For example, 
using a term such as “Asian values” implies that within multiple societies there is a commonality 
in world views and perspectives that can be considered distinctive. Searching for “Asian values” 
across societies assumes that there are “grand” theories of society that transcend geographies, 
histories, and cultures. As appealing as this idea might be, there is considerable skepticism about 
"grand theory” in social science research (Lyotard 1984). 


Chen (2005) has proposed, however, that research focused on “Asia as method” can overcome this 
problem (p. 141). Such research “ceases to look at Asia as object of analysis” (Chen 2005, p.141) 
but rather as a point of reference, and importantly as a means of “inter-referencing.” Koh (2018) 
urges scholars studying Asia to take an “inter-referencing perspective” where Western values 
are not the reference point for understanding Asian contexts. Rather, as Chen (2005) explained: 


u 


.. mediating through the horizon of ‘Asia’ as an imaginary anchoring point, societies in Asia 
could begin to mutually see the existence of one another and become one another's reference 
points” (p. 140). 


nter-referencing is the approach taken here to look comparatively at Korea, Taiwan, Hong 
Kong, Indonesia, and Thailand—participating countries in the International Civic and Citizenship 
Education Study (ICCS) 2009 (Fraillon et al. 2012). The first sections below summarize research 
studies examining the extent to which young people endorsed a set of common “Asian values.” 
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EXPLORING THEORY IN ASIA 


for example, is a construct derived from the Western experience. There is, for example, no 
simple Chinese translation for “citizen” (Guo 2014) and the possibilities are laden with political 
implications. Thus, the term, “citizenship education’ is rarely used in China because of the multiple 
meanings it can convey (Li 2015). Local contexts, therefore, are important sources for constructing 
meaning around terms and concepts imported from Western citizenship discourse. Given the 
range of Asian societies participating in ICCS 2009—Korea, Taiwan, Hong Kong, Indonesia, and 
Thailand—the significance of local contexts needs to be appreciated. 


The appreciation of context is the starting point for this chapter. Asian citizenship values 
represent historical, cultural, social, and political constructions from diverse societies within a 
single geographical region. These traditional values represent regional traditions that continue 
to influence young people along with the liberal democratic values that were reflected in the 
ICCS main survey (Schulz et al. 2010). Yet to some extent traditional values are independent, 
representing regional traditions that continue to influence young people. An important issue is 
how such values were identified and defined. 


For ICCS 2009, traditional values were identified during several meetings that included 
researchers from the participating Asian societies and ICCS 2009 managers. Specific items to 
reflect the values were agreed upon and formed scales for the ASQ. Lin and Liu (2011) describe 
this process, Kennedy (2011) provided an initial analysis and discussion, and Fraillon et al. (2012) 
reported the results. 


Traditional Values, Conceptions of “the Good Citizen,” and Civic Action: 
What Can be Learned About Asian Students’ Conceptions of Citizenship 
Responsibilities? 


The following questions will be explored with respect to the traditional values referred to above: 


e How did students from different societies within the region respond to questions and how 
can their responses be interpreted? 

e Are traditional values related to the way Asian students understand what it means to be “a 
good citizen?” How much agreement is there about what “a good citizen’ means? 

e |s there an association between students holding traditional values and their preferred forms 
of civic action? 


Student Responses and Some Interpretations 


Dou 


First, there was significant agreement on values. A "sense of Asian identity, “the need to 
preserve traditional culture,’ “the need for politicians to demonstrate a strong sense of morality,” 
and “a shared understanding of the qualities of ‘good citizens” received relatively high levels 
of endorsement, suggesting these were important shared values. There were other values that 
were endorsed more moderately. These were supportive of social conventions such as “respect 
for authority,’ the “need to maintain social harmony,’ and “authoritarian or paternalistic forms 
of government.” In addition, there was moderate to strong support for the integrity of each 
country’s legal system. 


Second, differences between countries were also found in attitudes “to corruption in the 
public service, jie 


Dou 


the use of ‘connections’ to gain political office,” "acceptance of undemocratic 
government,’ and “obedience towards authority.” Students from Korea, Taiwan, and Hong Kong 
gave these values generally negative endorsements. Students from Indonesia and Thailand were 
moderately positive. What do these patterns of endorsement on the ASQ scales mean? 


The overall picture is of young people who are quite conservative in their values, with some 
groups of students more conservative than others. They tend to subscribe to values related to 
obedience, authority, morality, harmony, tradition, and a sense of Asian identity. Westheimer 
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multidimensional nature of traditional values but also the 


nature of those values. One interpretation of Asian Civic Values is that they represent passive 
distinct moral dimension. These characteristics, however, appear to be 
consistent with holding democratic values concerning respect for individuals and tolerance for 
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difference. The other key finding 
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Other studies have used samples from ICCS 2009 students in several societies. One study 
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attitudes and their association with traditional values. For the Asian component she drew on 
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Using latent profile analysis (LPA) and a range of citizenship variables, she identified three 
profile groups of students within the region. The first she labelled “Outsiders” because on most 
beliefs, participation experiences, holding norms supporting conventional 
movement citizenship, and sense of efficacy, their scores were uniformly 


variables such as civic 
citizenship and social 


low. These students m 
the “Moderates” beca 


use their scores 


ade up 12% of the sample across the region. The second group she named 


on these variables were mostly average. These students 


made up 86% of the regional sample. The third group was named “Active Participators” because 


their scores were mos 


the region. Thus, this perso 


across the region, although the larges 


There were also differences within e 


of the national cohort 


wh 


tly above the mean for all variables. They made up 2% of the sample across 
n-centred methodology highlighted the diversity of citizenship values 


t group by far showed moderate engagement. 


ach of the societies. In Korea, Outsiders made up 24% 


e the perc 


entages were 14% in Hong Kong, 10% in Taiwan, 9% in 


Thailand, and 4% Indonesia. The existence of students who could be classified as Outsiders in 
every society points to some commonality across societies irrespective of culture and political 


system. They are largely neglected in citizenship research and citizenship education. Outsiders 


were not represented to the same extent in all societies but were more prevalent in democracies 
such as Korea than Indonesia. 


Kuang (2016) also found that boys were more likely to be Outsiders than girls and that students 
with lower expectations for further education and fewer books in the home were more likely to 


be Outsiders. These results were consistent with Knowles’ (2015) findings in Korea. In addition, 
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On several characteristics Korean students stood out perhaps because they seemed to be the 
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out: “geographic and cultural differences should be considered when understanding expected 


future option for the 


ttitudes to equality, and made up a 


c knowledge, lower c 
ues such as personal 


oreover, these diversities need to be further explored.” Political 
differences could also be included as part of these broad social contexts. This is a topic for 
qualitative research paying close attention to the cultural, political, and social contexts in which 
students live and develop citizenship values. 


Another topic of interest was illegal protest, especially given the student movements in Hong 
Kong and Taiwan beginning in 2014. Chow’s (2013) study, using ICCS 2009 data, found that 
legal protest was considered a future civic engagement option by a relatively small proportion 
of adolescents across the region. Similarly, Wang (2019), using a survey based on ICCS 2009, 
found with samples of students from Mainland China that around 10% endorsed illegal protest 
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e involved in the local student movements in these two societies beginning in 2014. 
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Conclusions and Future Directions 


De-emphasize Concern About Distinctive “Asian Citizenship Values” 


Most Asian students’ citizenship values are multidimensional. They include so-called traditional 
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While it is possible to describe how many Asian students select and act on their citizenship values, 
itis more difficult to understand their specific motivations. Civic knowledge is a strong predictor 
of positive citizenship values. It appears that many students with negative traditional values 
also have negative attitudes to democratic values such as voting, equality, and participation. Yet 
the mechanisms are unclear. Political efficacy needs to be better understood in Asian contexts, 
especially its links with Western individualism. The interplay between Asian value systems and 
other systems, and how together these influence students’ civic decision making are important 
areas for research. 


Examine “Active Citizenship” Asian Style 


Participation is a value for many Asian students and conventional participation is the preferred 
mode. At the same time some individuals are prepared to engage in illegal as well as legal 
forms of protest. In an important sense, the use of protest runs counter to traditional values 
concerned with obedience, harmony, and respect. Yet it is quite clear, given the “red” and 
“yellow” shirts in Thailand, the pro-Islamic protests in Indonesia, the “Umbrella” and “Sunflower” 
t 
p 


student movements in Hong Kong and Taiwan respectively, and the anti-Park protests in Korea, 
that some issues in these societies have the potential to prompt protest. For adults, at least, 
protest appears to be the only way to show a diminution of trust in the benevolence of political 
leaders. An important question: at what point, in a developmental sense, do most young people 
consider practicing these less conventional forms of civic engagement? It is clear from the studies 
discussed here that these less conventional forms of action are already part of potential civic 
repertoires for some adolescents. Yet what motivates actual civic action for young people is an 
important issue for future research. 


The majority of studies discussed above were conducted with samples of students who 
experienced, in one way or another, a democratic political environment (or at least a substantial 
amount of democratic discourse, for example, in Hong Kong). Wang's (2019) study included 
students from Mainland China, governed by a single party regime with no commitment to liberal 
democratic values. The students in her study endorsed participatory activity, but primarily as 
a regime supporting activity. This is in contrast to the democratic view that allows for and 
supports regime challenging activities. The way participation is both encouraged and enacted 
in authoritarian societies, the kind of incentives that exist, and what citizens hope to achieve 
need further study. 


Another important issue is the role of civic education. Reichert and Torney-Purta (2019), among 
others, have found that Asian teachers when asked about the goals of civic and citizenship 
education are especially likely to focus on conflict reduction and activities within the school 
itself. How students become oriented toward political and civic participation is an important 
area for further study. 


Be Aware of Strengths and Weaknesses of Methodologies 


Amethodology used in many of the studies cited above was person-centered analysis: two stage 
uster analysis (Chow 2013; Wang 2019), latent profile analysis (Kuang 2016) and mixture Rasch 
modelling (Kuang and Kennedy 2018). The question remains as to whether similar results will be 
ielded by different methods. This is not only an issue for the regional studies reviewed here. 
Person-centered analysis of civic and citizenship data has a short history (Torney-Purta 2009) 
but is enjoying increasing popularity (Reichert 2016; Reichert 2017; Reichert and Torney-Purta 
2019). Given the methodology’s potential for revealing patterns of heterogeneity in data sets, 
more work is needed comparing different statistical approaches. 
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quantitative and qualitative methods. Many studies include a suggestion that qualitative or 
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method studies are needed. Some attempts have been made to include a qualitative 
nent using students of the same age as those who were surveyed within the region, usually 
in interviews about specific issues (Au 2013; Cheung 2016). This is a promising way to explore 
in depth to see if those raised by one sample of students resonate with another sample. 
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Finally, this chapter has raised numerous issues. The studies have shown that values can be 
identified that seem especially appropriate in Asian contexts. It has established that there is 
diversity in the endorsement of these values across the region. The results challenge the idea that 
“Asian” values are uniformly adopted. Specific contexts appear to influence students to endorse 
values differently. Many questions remain and provide a challenge for future researchers using 
both traditional secondary analysis of survey data and qualitative research. 


The studies have shown that there are traditional values held by Asian adolescents and sometimes 
these are consistent with liberal democratic values (as generally defined), and sometimes they are 
not. An important issue is how young people balance these in their daily lives and interactions. 
Since 2014 we have seen radical forms of civic engagement in Asian contexts, but we do not 
know how such actions become reconciled with traditional values. When cultural pressures focus 
on obedience and harmony while societies pursue policies that are unfair and unjust, how do 
young people make decisions to protest the injustice? How does public discourse about radical 
civic action influence young adolescents whose political socialization is in process? These are 
important social questions, as well as significant research questions. They are questions that 
can be addressed by secondary data analysis to yield understanding that can benefit not only 
academic discourse, but the world in which we live. This presents an exciting research agenda 
for the future. 
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CHAPTER 21: 


Understanding School and Classroom Contexts for 
Civic and Citizenship Education: The Importance of 
Teacher Data in the IEA Studies 


Bruno Losito, Gabriella Agrusti, and Valeria Damiani 
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for participating in school life. We also present a brief review of the contributions (internatio 
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reports, articles, and papers) that used data collected from teachers. In the conclusions, we 


examine issues and challenges related to the use of the teacher questionnaire in future | 


studies in this field. 
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practices that consistently improve students’ learning across countries. In addition, one should 
consider that in a single survey it is not possible to measure the cumulative influence of all past 
teachers on the sampled students. 


To get a clearer picture we would need more in-depth questions, and this would be likely to 
further reduce teachers’ and schools’ willingness to participate in the study. 


The Teacher Questionnaire in Civic and Citizenship Education Studies: 
From the Six Subject Survey to ICCS 2016 


The analysis of the teacher questionnaires developed for the different IEA international surveys 
on civic and citizenship education provides an overview of the variables deemed relevant to 
include in the instruments and of different strategies adopted for teachers’ sampling. At the same 
time, it allows us to reflect both on the specific nature of civic and citizenship education within 
school curricula (in comparison with other areas) and on the changes that occurred over time 
in the conceptualizations of civic and citizenship education underpinning the IEA surveys. This 
mirrors the changes occurring in societies and in the role attributed to education and experience 
in the school context over the last 50 years. 


The first IEA survey on civic education, which was carried out between 1967 and 1971 within the 
Six Subject Survey, addressed some of the recurrent issues in this field of study—the importance 
of measuring not only cognitive aspects, but also attitudes related to civic participation and 
social justice, the focus on processes that occur inside and outside schools, and the status of 
civic education in school curricula. 


The analysis of the documents provided by the countries participating in the survey showed that 
there were different definitions of this subject area, different names given to it, and different 
ways of delivering it (Torney et al. 1975). These differences were reflected in the procedures 
for teacher sampling. For the 14-year-olds and pre-university populations teachers who taught 
civic education or subjects such as history, political science, geography, sociology, or economics 
were sampled. However, students and their teachers were not linked in the analysis. Teachers’ 
answers were meant to represent educational processes related to civic learning in the school 
overall, together with data collected through the principals’ questionnaire (Torney et al. 1975). 


The teacher questionnaire of the Six Subject Survey included questions similar to those 
administered to teachers in other IEA subject areas (such as teaching methods, student 
assessment, and years of training) together with other variables more related to civic education 
such as “amount of social science study; perception of the appropriateness of discussing 
controversial issues in the classroom; membership in subject matter associations; conception 
of the ‘good citizen; and the importance of teaching about topics such as democracy, political 
history, social problems, international problems, local and national government, and political 
parties” (Torney et al. 1975, p. 43). 


The huge political changes that occurred in the late 1980s and early 1990s triggered the 
organization of the second IEA study on civic education, CIVED, which was conducted in 1999. 
In investigating the ways young people were prepared to become citizens in democratic societies, 
the survey focused on school-based learning and on the influences and opportunities for civic 
participation outside school. 


The theoretical model developed for the study, called the Octagon, reflects the twofold focus of 
CIVED. In the model, schools (teachers, implemented curriculum, and participation opportunities) 
as well as peer groups, the family, and neighbors are viewed as “a ‘nested’ context for young 
people’s thinking and action in the social and political environment, and as “communities of 
discourse and practice” in which the individual student is at the center (Torney-Purta et al. 2001, 
p. 20). Based on these assumptions, teachers were identified sources of information about two 
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behavior at school and their perception of school climate (Schulz et al. 2010, pp.169-174). 
These data have unrealized potential. 


The shift from conceptualizing civic education as mainly conducted in a specific set of classes to 
CCE that included broader school opportunities also resulted in a particular sampling design for 
teachers. In ICCS 2009 and ICCS 2016, the teacher questionnaire was administered to up to 15 
teachers of all subjects sampled from all teachers who were teaching at the target grade (grade 
8) during the testing period (if they had been employed at the sampled school at least since the 
beginning of the school year). In ICCS, the approach underpinning this sampling design was to 
survey teachers from civic-related and non-civic-related subjects without linking the teachers 
to the students who took the test. 


To summarize the contrast, CIVED surveyed teachers who taught subjects mainly related to 
humanities and social sciences, while in ICCS the teacher questionnaire was administered to a 
sample of teachers of all subjects at the target grade. The aim was to take school contexts and 
characteristics into account, as they constitute the general culture and climate in which civic 
and citizenship education is developed (Schulz et al. 2008, p. 36). 


The possibility to use teachers as source of information without focusing exclusively on history and 
social studies related subjects corresponds to two assumptions: i) that CCE is a cross-curricular 
theme that can be implemented including all subjects as well as in specific classes; ii) that civic- 
related learning outcomes can be influenced by the characteristics of the school environment 
as a whole (whole-school approach). The findings were discussed in the international reports 
and in secondary analyses, as reported in the next section. 


The teacher questionnaire in ICCS 2009 comprised 29 questions divided into four sections: 
general information, the school context, CCE at school, and the teaching of CCE. The last section 
was part of the international option addressed only to individuals within the teachers’ sample 
in each school who were teaching CCE-related subjects. The ICCS 2009 teacher questionnaire 
encompassed four questions that were similar to the ones included in the teacher questionnaire in 
CIVED. Those questions were about the sources used for planning civic and citizenship education, 
on how teachers assess their students in CCE, on teachers’ confidence about teaching specific 
topics related to CCE, and on teachers’ ideas about the improvements needed in this area. 


CCS 2016 shares the research design and sampling procedures of the 2009 survey. One of 
the research questions of the study investigates the extent to which schools have participatory 
processes in place that facilitate civic engagement, the extent to which schools and communities 
interact to foster students’ civic engagement and learning and, finally, the ways schools and 
teachers perceive the role of civic and citizenship education (Schulz et al. 2016). 


O 
> 


The general structure of the ICCS 2016 teacher questionnaire follows the one adopted in 
2009—first, teachers' general information, second, the school, and third, CCE at school. It was 
addressed to teachers teaching regular school subjects to students in the target grade, questions 
and items related to the new areas included in the student survey (environmental sustainability, 
social interaction at school, and the use of new social media) were also included in the teacher 
questionnaire. Eleven questions were modified from the 2009 version, six were unchanged, and 
five questions were inserted related to the new focus areas of the study. A fourth section on the 
teaching of CCE was an international option for teachers of civic-related subjects. Thirty-five 
out of 38 countries participated in this option. 


Several aspects of continuity as well as differences can be identified across the four surveys. 
These aspects reflect changes that occurred in the conceptualization of civic and citizenship 
education and to its delivery at a school level over time. In our view, the following are the major 
aspects of continuity: 
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their role in students’ civic and citizenship education, although this highly depends on how CCE 
is conceptualized and delivered in individual school systems and on responsibilities assigned to 
teachers at the school level in addition to their teaching. 


ncreased attention paid to the school context did not imply less attention to specific aspects of 
the teaching of CCE in a more specialized sense. In ICCS we included an international option in 
the questionnaire for teachers whom the national centers identified as teachers of civic-related 
ubjects. In ICCS 2009 35 out of 38 countries participated in this option, while in ICCS 2016, 
| countries participated in it. In both surveys most teachers of civic-related subjects reported 
that they felt very well prepared or quite prepared to teach almost all the topics and issues 
isted in the question. The highest percentages were recorded for human rights, citizens’ rights 
and responsibilities, and equal opportunities for men and women (Schulz et al. 2010; Schulz 
et al. 2018). 


o Wn 


n concluding this overview of the characteristics of the teacher questionnaires across the 
different IEA studies on CCE, it is important to highlight some developments that, in our view, 
should be taken into consideration in relation to the instrument for collecting teachers’ data in 
future surveys on CCE. 


t is not easy to identify which aspects of teacher activities at the school level contribute to 
students’ outcomes in CCE across countries. In selecting the constructs and variables to be 
included in the teacher questionnaire, one needs to examine not only the results in ICCS (at 
both international and national levels), but also studies on teachers carried out in individual 
countries. This could suggest more in-depth ways to investigate this area in the future, also 
through qualitative studies, aimed at looking more in depth at the results of international surveys 
see, for example, Toots and Lauri 2015) and at gathering data on country-specific issues that 
are not included in IEA surveys (such as, for instance, the role of non-teaching staff). These kinds 
of studies, even if they do not allow for cross-country comparisons, can provide insights from a 
different perspective that could benefit from both the quantitative and the qualitative approaches. 
In CIVED, during the Phase 1 of the project, NRCs wrote national case studies that also allowed 
to better identify constructs and variables to be included in the teacher questionnaire (as well 
as in the other CIVED contextual questionnaires) (Mintrop 2002). 


More generally, there is a need to update the content of the teacher questionnaire in each new 
cycle to reflect the changes that have been introduced over time in school curricula, and in the 
delivering of CCE. Changes introduced in the student test and questionnaire might suggest the 
inclusion of new topics for the teacher questionnaire, as it was done in ICCS 2016 in relation to 


environmental sustainability, and as it is proposed for ICCS 2022 in relation to global citizenship 
education. 


There is one more aspect that is important to mention. In the Six Subject Survey report (Torney 
et al. 1975), the authors pointed out the importance of using different sources of information 
school, teacher, and student) “to characterize the educational inputs in different countries 
permitting us to gain a better understanding of the patterns of achievement” (p. 66). In ICCS 
2009 and 2016, several questions were included in the school and teacher questionnaires that 
were similar to the questions administered in the student questionnaire (e.g., perceptions of 
bullying at school, students’ participation at school, and perceptions of students’ and teachers’ 
relations). This allowed a comparison between teachers’ and students’ perceptions. For example, 
when analyzing students’ and teachers’ answers to the questions on bullying, it emerged that 
teachers appear to underestimate the phenomenon (also in comparison with principals’ reports) 
Schulz et al. 2018). So, it is important to maintain “parallel” questions across the instruments. 
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The Use of Data Collected Through the Teacher Questionnaire: 
International Reports and Secondary Analyses 
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Secondary Analyses of Teacher Questionnaire Data 


In the last 20 years, a number of secondary analyses were carried out using CIVED and ICCS 
teacher questionnaire data. Two recent reviews of the research conducted across different 
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In relation to the studies using the teacher questionnaire data, we have identifed two main 
strands of academic research in these reviews. The first strand focused on teachers’ beliefs and 
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understanding of the associations between school factors and students’ future electoral and 


political participation (Sampermans et al. 2018; Quinteli 
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n ICCS 2009, a question on teachers’ personal participation in civic-related activities outside 
the school was included (i.e., participation in political parties and organizations, in trade unions, 
in groups promoting the welfare of ethnic minorities). The idea was that it could be important 
to explore whether teachers’ opinions on CCE were related to their out-of-school experiences 
with social and political participation. An analysis of this data from twelve countries indicates 
that teachers’ participation in organizations outside the classroom is associated with some of 
their decisions about pedagogy (Reichert et al. 2020). Being active in out-of-school political, 
social, and community activities appears to enable teachers to connect abstract civic principles 
with real life examples relevant to their students. However, this question was not included in 
the ICCS 2016 questionnaire. 


Some countries decided to include relevant questions in the teacher questionnaire as a national 
option. For example, the Belgium Flemish included a question on teachers’ perception of the 
importance of different forms of social and political action for being a good citizen (using items 
from a similar question on the student questionnaire). The possibility of including such questions 
in the teacher questionnaire in the future should be explored. 


Another issue that should be addressed more comprehensively in the teacher questionnaire 
relates to students’ participation at school. Including questions on this topic could provide 
researchers with data from the perspective of teachers on the democratic environment students 
experience at schools and on which aspects of school life they are involved in (from school 
management to lesson and extra-curricular activities planning). 


n conclusion, teachers’ views about their schools and students in the area of CCE remain an 
important part of these studies. In our view, future research in this area could use the results 
of large-scale assessment as a starting point for small-scale studies aimed at understanding 
specific CCE teaching and learning contexts. More specifically this could include analyses of the 
teaching and learning processes that occur at the classroom and the school levels. Integrating 
arge-scale and small-scale studies could help researchers shed light on issues that need to be 
further investigated, and that constitute relevant aspects of CCE across educational systems. 
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CHAPTER 22: 


The Landscape and Recent Developments of 
Civic and Citizenship Education Across the Latin 
American Region 


Andrés Sandoval-Herndndez and Daniel Miranda! 


Abstract This chapter was invited to provide a description of the landscape of the international 
dimension of IEA’s International Civic and Citizenship Education Study (ICCS) within the Latin 
American region. These authors possess extensive experience in analyzing and publishing from 
these datasets. The chapter begins by describing their professional, academic, and personal 
involvement with IEA's civic education studies. This is followed by an analytical review of peer- 
reviewed articles, books, as well as research projects that included ICCS data as part of their 
empirical evidence. It also describes the people, institutions, and research teams that have been 
involved in these projects. The result of this review is divided into two sections: a characterization 
of the topics that have proven relevant for the region, and mapping of the specific overlaps 
between these topics and the contents of the ICCS datasets. Finally, there are specific suggestions 
that could contribute to raising the profile of ICCS as a key resource for the discourse on civic 
education in Latin America. 


Introduction 


Twenty years ago, there was relatively modest interest among Latin American educational 
researchers in the topic of civic education viewed internationally or regionally. In the International 
Association for the Evaluation of Educational Achievement (IEA) Civic Education Study (CIVED), 
testing in 1999 and 2000, only Chile and Colombia participated (Torney-Purta et al. 2001; Amadeo 
et al. 2002). Ten years later, in the first cycle of the IEA’s International Civic and Citizenship 
Education Study (ICCS) (Schulz et al. 2009) there was additional participation with a total of six 
countries (Mexico, Guatemala, Colombia, Chile, Dominican Republic, and Paraguay). As important, 
there was a module of questions specific to the region and a report was published of these 
regional results (Schulz et al. 2011). In ICCS 2016 four of these countries participated again 
Mexico, Colombia, Chile, and the Dominican Republic) and Peru joined for the first time (Schulz 
et al. 2018). The participation of these countries in the IEA studies has meant that, instead of 
isolated countries providing snapshots of this region, over the past two decades a landscape 
of countries where civic opportunities and civic education vary greatly can be examined in a 
comparative fashion. 


This growing interest in civic and citizenship education in the region has been coupled with the 
emergence of a network of researchers across Latin American countries. Currently, this network 
involves more than 15 institutions and about 30 individuals in the region but also extends 
to other institutions outside Latin America, such as Harvard University in the United States, 
the University of Deusto in Spain, and the University of Bath in the United Kingdom where 
collaborating researchers have been located. 


1 This chapter was supported by the National Agency of Research and Development through the grants ANID/ 
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The involvement of Andres Sandoval-Hernandez (one of the co-authors of this chapter) with 
ICCS began in 2010 when he started working at the Research and Analysis Unit of IEA’s Data 
Processing Centre (DPC), in Hamburg, Germany. The activities at this unit consisted of carrying 
out analysis on IEA datasets across subject areas and offering training focused on secondary 
analyses of IEA’s data. At that time, the data from ICCS 2009 was freshly released and many of 
the training activities focused on this study. These activities created opportunities for several 
individuals who are now part of the network of researchers on ICCS across Latin American 
countries. For example, Ernesto Treviño, Juan Carlos Castillo, Diego Carrasco, Silvia Diazgranados, 
and Daniel Miranda (the co-author of this chapter), participated in one or more of the workshops 
organized by IEA and currently participate or have participated in one or more of the multi-year 
research projects based on analyses of ICCS data. 


Other good examples of the impact of IEA activities on the development of research networks 
and products are the multi-year and multi-institution research projects based on ICCS data 
that have been funded by national governments (i.e., Chile and Mexico) and by international 
institutions (i.e., the Inter-American Development Bank). The projects funded by the Chilean 
ational Commission for Science and Technology and the Mexican National Council for 
Science and Technology, consisted of a series of activities including reciprocal visits among 
the researchers working at different institutions. These projects culminated in the publication 
of a book (Sandoval-Hernåndez et al. 2018) and more than 10 academic chapters and articles 
focused on civic and citizenship education in Latin America (e.g., Castillo et al. 2014a; Garcia- 
Cabrero et al. 2016; Garcia-Cabrero et al. 2017; Miranda et al. 2015). The project entitled 
Regional System for the Evaluation and Development of Citizenship Competences (SREDECC 
was founded in 2005 with the economic aid of the Inter-American Development Bank. The 
SREDECC was operationally supported by the Regional Center for the Promotion of Books in 
Latin America and the Caribbean (CERLALC). One of the main outcomes of this project was 
the development of a Latin American module of questions for ICCS 2009 and the publication 
of nine reports associated with its results (several in Spanish): a report summarizing citizenship 
curricula in the region, a regional report about civic knowledge of the students in the region, six 
national reports (Chile, Colombia, Guatemala, Mexico, Paraguay, and the Dominican Republic 
a 
a 


nd a regional report in Spanish about successful practices in citizenship education (Reimers 
nd Villegas-Reimers 2011). 


It can be said that some of the main achievements of ICCS in Latin America have been the 
development of technical expertise for the evaluation of civic and citizenship education, impact 
on the policy and practice of the countries that have participated in the IEA studies, and the 
establishment of a community of researchers (many at universities) who are interested in the 
development of in-depth studies based on secondary analyses of ICCS data. In this chapter, 
we focus on the academic products of this community of researchers, a characterization of 
the topics that have particular relevance for the region and a mapping of the specific overlaps 
between these topics and the contents of the ICCS datasets. In the remainder of this chapter, 
we outline a landscape of the research outputs of ICCS in Latin America, as well as some specific 
suggestions to raise the profile of ICCS as a key resource for enhancing future discussions on 
civic education in the region. 


A Landscape of Research Outputs Based on the ICCS in Latin America 


The next section describes a set of scholarly products that have investigated issues relevant to 
the region using ICCS data. We identified a total of more than 30 books, book chapters, and 
peer-reviewed papers since 2004. Before 2013, four publications were produced: one book, 
one book chapter, and two articles in peer-reviewed journals. From this period, it is important 
to highlight the book analyzing CIVED data by Torney-Purta et al. which was published by the 
Organization of American States (OAS) in English (2004b) and Spanish (2004a) through its Unit 
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Since 2014 the numbers of 
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1), and 18 papers (see Table 2) have been produced during this second period. 


Table 1: Books and book chapters 
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Author 


Year 


Title and publisher 


Language 


Type 


Torney-Purta, J., Amadeo, 
J.-A., & Pilotti, F. 


2004 


Strengthening democracy in the Americas 
through civic education: An empirical analysis 
highlighting the views of students and teachers. 
Washington, DC: Organization of American 
States. 


English/Spanish 


Book 


Cox, C., & Castillo, J. C. 


2015 


Aprendizaje de la ciudadania: Contextos, 
experiencias y resultados [Citizenship learning: 
Contexts, experiences and results]. Santiago, 
Chile: Ediciones UC. 


Spanish 


Book 


Miranda, D., Castillo, J. C., & 
Sandoval-Hernandez, A. 


2015 


Desigualdad y conocimiento civico: Chile en 
comparación internacional [Inequality and civic 
knowledge: Chile in international comparison]. 
In C. Cox, & J.C. Castillo (Eds.), Aprendizaje 
de la Ciudadania. Contextos, Experiencias 

y Resultados [Citizenship learning contexts, 
experiences and results]. Santiago, Chile: 
Ediciones UC. 


Spanish 


Book chapter 


Garcia-Cabrero, B., 
Sandoval-Hernandez, A., 
Trevino, E., Diazgranados- 
Ferrans, S., & Martinez, G. 


2017 


Civics and citizenship: Theoretical models and 
experiences in Latin America. Amsterdam, the 
Netherlands: Sense Publishers. 


English 


Book 


Trevino, E., Béjares C., 
Villalobos C., & Naranjo E. 


2017 


Building citizenship in the schools of Chile, 
Colombia and Mexico. In B., Garcia-Cabrero, 
A. Sandoval-Hernåndez, E. Trevifio-Villareal, 
S.D. Ferråns, M.G.P. Martinez (Eds.), Civics and 
citizenship. Rotterdam, the Netherlands: Sense 
Publishers. 


English 


Book chapter 


Garcia-Cabrero, B., 
Sandoval-Hernåndez, A., & 
Martinez, M. G. P. 


2017 


Affective and cognitive processes as 
determinants of civic participation in Latin 
American countries. In B., Garcfa-Cabrero, 

A. Sandoval-Hernández, E. Treviño-Villareal, 
S.D. Ferráns, M.G.P. Martínez (Eds.), Civics and 
citizenship (pp. 127-153). Rotterdam: Sense. 


English 


Book chapter 


Diazgranados-Ferráns, S. D., 
& Sandoval-Hernández, A. 


2017 


The civic competence gaps in Chile, Colombia 
and Mexico and the factors that account 

for the civic knowledge gap: Evidence from 
the 2009 International Civic and Citizenship 
Education Study (ICCS). In B., García-Cabrero, 
A. Sandoval-Hernández, E. Treviño-Villareal, 
S.D. Ferráns, M.G.P. Martínez (Eds.), Civics and 
citizenship (pp. 155-192). Rotterdam: Sense. 


English 


Book chapter 
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Table 1: Books and book chapters (contd.) 


Author Year Title and publisher Language Type 
Trevino, E., Sandoval- 2019 nvarianza de las escalas de nivel Spanish Book chapter 
Hernandez. A., Miranda, D., socioeconomico en estudios internacionales. 

Rutkowski, D., & Matta, T. nJ. Manzi, M. R. García, € S. Taut (Eds.), 


Validez de evaluaciones educacionales en Chile y 
Latinoamérica (pp. 301-328). Santiago, Chile: 
Ediciones Universidad Catölica de Chile. 


Castillo, J. C., Miranda, D., & 2019 edición de actitudes hacia la igualdad Spanish Book chapter 
Bonilla, A. de derechos entre géneros en pruebas 
internacionales: Implicacias respecto a su 
validez. In J. Manzi, M. R. García, € S. Taut 
(Eds.), Validez de evaluaciones educacionales en 
Chile y Latinoamérica (pp. 329-356). Santiago, 
Chile: Ediciones Universidad Católica de Chile. 


Table 2: Peer-reviewed articles 


Author Year Title and publisher Language Type 


Reimers, F. 2007 Civic education when democracy is in flux: English paper 
The impact of empirical research on policy 
and practice in Latin America. Citizenship and 
Teacher Education, 3(2), 5-21. 


Caro, D. H., & Schulz, W. 2012 Ten hypotheses about tolerance toward English paper 
minorities among Latin American adolescents. 
Citizenship, Social and Economic Education, 
11(3), 213-234. 


Castillo, J.C, Miranda, D., 2014a Social inequality and changes in students’ English paper 
Bonhomme, M., Cox, C., & expected political participation in Chile. 
Bascopé, M.. Education, Citizenship and Social Justice, 9(2), 

140-156. 
Valencia Serna, A., & Vivas 2014 La apertura a la discusión en la sala de Spanish paper 
Pacheco, H. clases y su relación con la educación para 


la ciudadanía [The open classroom for 
discussion and its relation with citizenship 
education]. Revista Colombiana de Educación, 


66, 223-242. 
Collado, D., Lomos, C., & 2015 The effects of classroom socio-economic English paper 
Nicaise, I. composition on student's civic knowledge 


in Chile. School Effectiveness and School 
Improvement, 26(3), 415-440. 


Castillo, J.C, Miranda, D., 2015 Mitigating the political participation gap from English paper 
Bonhomme, M., Cox, C., & the school: the roles of civic knowledge and 
Bascopé, M. classroom climate. Journal of Youth Studies, 

18(1), 16-35. 
Bascopé, M., Bohnomme, 2015 Curricular guidelines and citizenship attitudes English paper 
M., Cox, C., Castillo, J.C., & in Latin American students: a comparative 
Miranda, D. analysis. Revista Latinoamericana de Ciencias 

Sociales, Niñez y Juventud, 13(2), 1169-1190. 


Ortiz, | 2016 Actitudes de los estudiantes en escuelas Spanish paper 
segregadas y en escuelas inclusivas, hacia la 
tolerancia social y la convivencia entre pares 
[Attitudes of students in segregated schools and 
in inclusive schools, towards social tolerance and 
peer coexistence]. Calidad en la educacion, (44), 
68-97. 


LANDSCAPE AND RECENT DEVELOPMENTS ACROSS LATIN AMERICAN REGION 


Table 2: Peer-reviewed articles (contd.) 


265 


Author Year Title and publisher Language Type 
Garcia-Cabrero, B., Pérez- 2016 Assessing two theoretical frameworks of English paper 
Martinez, M. G., Sandoval- civic engagement. Journal of Social Science 
Hernandez, A., Caso-Niebla, Education, 38-52. 
J. € Díaz, C. 
Chaux, E., & León, M. 2016 Homophobic attitudes and associated factors English paper 
among adolescents: A comparison of six Latin 
American countries. Journal of homosexuality, 
63(9), 1253-1276. 
Treviño, E., Béjares, C., 2017 Influence of teachers and schools on students' English paper 
Villalobos, C., & Naranjo, E. civic outcomes in Latin America. The Journal of 
Educational Research, 110(6), 604-618. 
iranda, D., Castillo, J.C., & 2017 Young citizens participation: Empirical testing English paper 
Sandoval-Hernández, A. of a conceptual model. Youth & Society, 52(2), 
251-271. 
Treviño, E., Béjares, C., 2018 Forms of youth political participation and English paper 
Villalobos, C., & Naranjo, E. educational system: The role of the school 
for 8th grade students in Chile. Young, 27(3), 
279-303. 
Webster, N., Sausner, E., 2018 The intersection of civic engagement and English paper 
Alobaibi, B., & Patterson, A. civic attidues among Latino youth through a 
factor analysis. Journal of Social Change, 10(1), 
159-168. 
Sandoval-Hernádez, A., 2019 Pensémoslo de nuevo: ¿podemos comparar Spanish/English paper 
Rutkowski, D., Matta, T., & las escalas de antecedentes socioeconómicos? 
Miranda, D. [Back to the drawing board: Can we compare 
socio-economic background scales?]. Revista de 
Educacion, (383), 37-61. 
Snow, K., & Kennedy, K. 2019 Alienated and disaffected students: Spanish/English paper 
Exploring the civic capacity of 
‘Outsiders’ in Latin America. Education, 
Citizenship and Social Justice. https://doi. 
org/10.1177/1746197919886877 
Carrasco, D., Banerjee, R., 2019 Civic knowledge and open classroom Spanish/English paper 
Trevifio, E., & Villalobos, C. discussion: explaining tolerance of corruption 
among 8th-grade students in Latin America. 
Educational Psychology, 40(2), 186-206. 
Martinez, L., Cumsille, P., 2020 Patterns of civic and political commitment English paper 
Loyola, l., & Castillo, J.C. in early adolescence. The Journal of Early 
Adolescence, 40(1), 5-27. 


Furthermore, several masters and doctoral theses were developed between 2013 and 2019. Table 
st of the theses came from departments of sociology, psychology, 


3 lists these documents. Mo 


and education, which can be c 
perspectives that are covered in 


interpretations using Robert 


Additionally and importantly, since 2007, seven mult 


were carried out. Five of 
Technology of Chile (CONIC 


by the Mexican National Council for Science and Tec 


projects focused on the his 
countries. They consider asp 


onsidered a good representation of the several disciplinary 
CCS questions. The edited book published in 2017 introduced 


Selman's theory about informed social reflection, which provides a 
valuable new perspective on civic education generally (not only in Latin America). 


YT), one by the Inter-Am 


torical and current con 


hnology (CO 
text of the civic culture of Latin American 


ti-year, externally funded, research projects 
them were funded by the National Commission of Science and 


erican Development Bank (BID), and one 
ACYT) (see Table 4). All these 


ects such as dictatorships in the region in recent decades, political 
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Table 3: Doctoral and masters theses 
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Author 


Year 


Title and publisher 


Status 


Type 


Angélica Valencia 


2013 


La educación para la ciudadanía en 
Colombia: un análisis a partir de las pruebas 
internacionales sobre educación cívica de 
la IEA. School of Sociology, Universidad del 
Valle. 


Finished 


Thesis 


Silvia Diazgranados 


2016 


The civic knowledge gaps in Chile, Colombia 
and Mexico: An application of the Oaxaca- 
Blinder decomposition method using data 
from the 2009 International Civic and 
Citizenship Education Study (ICCS). Ed.D. in 
Human Development and Education, Harvard 
University. 


Finished 


Thesis 


Alex Guerrero 


2016 


Perfiles de escuela en formación ciudadana. 
aster in Sociology, Sociology Institute, 
Pontificia Universidad Católica de Chile. 


Finished 


Thesis 


Amgelica Bonilla 


2016 


Tolerancia a la diversidad social de los 
estudiantes chilenos según determinantes 
socioeconómicos y de género: Reevaluando 
os efectos de la composición social de las 
escuelas. Master in Sociology, Sociology 
nstitute, Pontificia Universidad Católica de 
Chile. 


Finished 


Thesis 


Francisco Carreño 


2016 


Predictores de la confianza institucional: el 
caso de Chile. Master in Sociology, Sociology 
nstitute, Pontificia Universidad Católica de 
Chile. 


Finished 


Thesis 


Daniel Miranda 


2018 


nequality and citizenship: an intergenerational 
approach. Ph.D. Program, Sociology Institute, 
Pontificia Universidad Católica de Chile. 


Finished 


Thesis 


Carolina García 


2018 n 


nterpretaciones y paradojas de la educación 
ciudadana en Chile: una aproximación 
comprensiva desde las significaciones 
ciudadanas y pedagógicas de los profesores de 
historia. Educational science program, Faculty 
of Education, Pontificia Universidad Católica 
de Chile. 


Finished 


Thesis 


Loreto Muñoz 


2019 


Actitudes hacia la igualdad de género en 
adolescentes chilenos: ¿cómo influyen los 
padres en sus hijos? Master in Sociology, 
Sociology Institute, Pontificia Universidad 
Católica de Chile. 


Finished 


Thesis 


Carolina Miranda 


2019 


Expected political participation and attitudes 
oward equality: the role of gender. Master 
in Sociology, Sociology Institute, Pontificia 


Finished 


Thesis 


Universidad Católica de Chile. 


disaffection of citizens observed in decreasing leve 
and, finally, academic and public policy concerns ab 
of citizenship education. These projects have been 


potential outcomes in Latin American countries using CIVED and ICCS data. Some researchers 
have collected further qualitative and quantitative data 


which is a potential source for new analysis and pu 


s of institutional trust and/or voter turno 
out poor results in international evaluatio 
oriented to understand civic education a 


best examples of the future use of findings from 
improvement of civic education. 


(cross-sectional and longitudina 
blications by scholars. These are among the 
the ICCS studies and how they impact the 


> 
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Table 4: Externally funded research projects using civic and citizenship education data 


Author 


Period 


Project title 


Banco Interamericano de Desarrollo 


2007 to 2011 


Sistema Regional de Desarrollo 
y Evaluaciön de Competencias 
Ciudadanas (SREDECC). Funded by 
BID 


Cristian Cox, Faculty of Education, Pontificia 


Universidad Catölica de Chile 


artin Bascopé, Faculty of Education, 


Chile 
Daniel Miranda, Pontificia Universidad 
Catölica de Chile 


Juan Carlos Castillo, Measurement Center 
IDE UC, Pontificia Universidad Católica de 


Pontificia Universidad Catölica de Chile 


2012 to 2014 


Socialización política y experiencia 
escolar: Chile en contexto 
internacional. Funded by CONICYT 


Benilde 
Unive 

Andrés 
Bath, U 


ity of Mexico, Mexico 


ited Kingdom 


University of Chile, Chile 

Silvia Diazgranados Ferrans, Harvard 
Graduate School of Education, USA 
aria Guadalupe Pérez Martinez, CO 
Autonomous University of Aguascal 
exico 


Garcia-Cabrero, National Autonomous 
Sandoval-Hernåndez, University of 


S 
Ernesto Treviño-Villareal, Pontifical Catholic 
S 


ACYT 


ientes, 


2014 to 2016 


The Civic Participation of High 
School Students in Mexico, Chile 
and Colombia: A Comparative 
Analysis. Funded by CONACYT 


Rodrigo Mardones, School of Political 
Pontificia Universidad Católica de Chi 
Alejandra Marinovic, Universidad Ado 
bañez 


Science, 
e 
fo 


2017 to 2019 


Citizenship education as a Public 
Policy. Funded by CONICYT 


Ernesto Treviño, Faculty of Education, 


Pontificia Universidad Católica de Chi 


e 


Diego Carrasco, Measurement Center MIDE 
UC, Pontificia Universidad Catölica de Chile 
Cristobal Villalobos, Faculty of Education, 
Pontificia Universidad Catölica de Chile 


2018 to 2020 


Sistema escolar chileno y el 
desarrollo de resultados civicos. 
Formas de implementaciön, 
mecanismos de recontextualización 
de la política educativa e influencia 
de la escuela en el conocimiento, 
actitudes y participación cívica de los 
jóvenes. Funded by CONICYT 


Cristian Cox, Faculty of Education, Pontificia 


Universidad Católica de Chile 


Universidad de Chile 


Juan Carlos Castillo, School of Sociology, 


Daniel Miranda, Measuremen 
UC, Pontificia Universidad Ca 


Diego Portales 


Center MIDE 
tólica de Chile 


Camila Jara, Faculty of Education, Universidad 


2018 to 2021 


Socialización política y educación 
para la ciudadanía: el rol de la familia 
y de la escuela. Funded by CONICYT 


Daniel Miranda, Measuremen 
UC, Pontificia Universidad Ca 


t Center MIDE 
Ölica de Chile 


2019 to 2022 


Participación Ciudadana Juvenil: 
entre la reproducción social y la 
socialización política. 
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These projects have consisted of in-depth investigations concerned with different levels or 
aspects of education and different agents involved in the process of citizenship education. At 
the individual level, the research teams have examined the role of family characteristics (such as 
socioeconomic background, socialization practices, and attitudinal patterns) and its association 
with civic outcomes, particularly civic knowledge and citizenship participation. At the school 
level, these projects have examined the influence of school characteristics and processes on Civic 
outcomes. For example, they investigate teaching practices and approaches designed to produce 
a more in-depth understanding of this dimension of the school experience than in previous 
projects and publications. Finally, at the public policy level, they are producing information about 
changes and stabilities of policies and what this means for the future. 


Topics Addressed in the Latin American Publications 


A review of these scholarly products allows us to map the ICCS analyses and results onto the 
topics that are considered especially relevant for the region. Examining the dependent variables 
found in the publications and projects described above, we conclude that scholars of the region, 
besides civic knowledge, have been mainly interested in two topics: citizenship participation and 
students’ attitudes toward equality and tolerance. 


Even though civic knowledge is one of the main aspects of all IEA studies including ICCS, not 
many publications using Latin American data have focused on it, only three articles and two book 
chapters (in addition to the IEA national and international reports). As in other international large- 
scale assessments (ILSA), the countries of the region obtain low achievement scores compared 
to the international averages. For those countries that have participated in ICCS 2009 and 2016, 
an increase in the average levels of civic knowledge was observed with the exception of Chile, 
where results showed no significant change between the two time points. In the same vein, as 
in other regions of the world, the individual factors that have a consistent association with civic 
knowledge are students’ home literacy resources, gender (with females obtaining higher scores 
in almost all countries), expected years of education and perception of openness for discussion 
in classroom (Castillo et al. 2015; Collado et al. 2015; Torney-Purta et al. 2004; Treviño et al. 
2017; Valencia Serna and Vivas Pacheco 2014). Regarding the contextual school-level factors, the 
socioeconomic composition of the school and open classroom for discussion are both strongly 
and consistently associated with students’ levels of civic knowledge (Castillo et al. 2015; Collado 
et al. 2015; Miranda et al. 2015). 


As mentioned before, citizens’ participation has also been a topic studied by Latin American 
scholars. On the one hand, there are some efforts oriented to its conceptualization (Miranda 
2018; Miranda et al. 2017). On the other hand, efforts have also been oriented to explaining 
different types of participation. For instance, authors have shown that family socioeconomic 
measures are closely related to differences in expected formal participation among students 
Castillo et al. 2014b; Castillo et al. 2015). Additionally, the same authors have found that some 
school practices, such as the openness of classrooms for discussion, could help to ameliorate 
intergenerational inequalities related to low civic and political participation. In the case of 
participation in protests or demonstrations, some authors have shown that the discussion of 
political and social issues with family and peers is one of the main factors associated with this 
type of participation (Treviño et al. 2017; Treviño et al. 2018). And in the case of community or 
social participation, several analyses have pointed out that political discussion and the perception 
of the openness of classrooms for discussion have a positive association with this type of 
participation, while civic knowledge has a negative one (Martinez et al. 2019; Valencia Serna 
and Vivas Pacheco 2014). Although several authors in the region have addressed the topic of 
participation, further analyses are needed in order to understand some unexpected results (e.g., 
the negative association between community participation and civic knowledge) and changes 
across time, just to mention two issues (Miranda 2018). 
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Tolerance and attitudes toward equal rights for immigrants or ethni 


that has received considerable attention in the region. A numb 
(Caro and Schulz 2012; Sandoval-Hernandez et al. 2018), as we 


c minorities is another topic 
er of peer-reviewed papers 
| as several master’s theses 


(see Table 3) have addressed this topic. This increasing interest is consistent with the changing 


societal patterns of migration and demands for equality from social 


y disadvantaged groups. For 


this reason, research on this topic has considerable potential to produce relevant information 


to inform policy development in the future Latin American contex 
papers that investigate this topic indicate that socio-economic posit 


roles in explaining different levels of support for equal rights for mi 


Another interesting pattern is that a large proportion of the research publications with ICCS data 


t. Some of the results of the 
tion and gender play relevant 
nority groups. 


have been focused on three Latin American countries: Mexico, Chi 
Latin American countries that have participated in ICCS, such as Guatemala, Dominican Republic, 


le, and Colombia. The other 


and Paraguay in 2009, and Guatemala and Peru in 2016, have received less attention. This could 


be, at least in part, due to the availability of research grants in 


and the availability of skilled personnel in well-developed evaluation centers. Although the BID 
aunched a first Regional System for the Evaluation and Development of Citizenship Competences 
SREDECC) that originally included Chile, Colombia, México, Guatemala, Paraguay, and th 


exico, Colombia, and Chile, 


e 
Dominican Republic, it appears that only the first three countries implemented a sustainable 
strategy to follow-up on the actions initiated by SREDECC (Reimers and Villegas-Reimers 2011). 


An analysis of the set of scholarly publications covered here suggests that the Latin American 


Module of ICCS (Schulz et al. 2011) has received relatively little atte 
sensitive scales included in the Latin American Module remain 


ntion. Many of the politically 
practically unexplored (e.g., 


tolerance to corruption, authoritarian attitudes, disobedience to law, and peaceful co-existence). 
Of even more interest, in the ICCS 2009, a set of sixteen items measuring civic knowledge with 


a focus on Latin American issues was administered. Regardless of 
this scale, it has not received attention from scholars. 


the analytical possibilities of 


tioned above is oriented to 


We know that at least one of the current research projects men 
deepen understanding of topics such as tolerance for corruptio 


n or authoritarian attitudes 


(see Socialización politica y educación para la ciudadanía in Table 4). The results of such analyses 


are anticipated with interest by practitioners and policymakers, a 
Montes, President of the Chilean Senate during the Seminar Youth 
Citizenship organized by the Center for the Study of Conflict and 
Santiago, Chile in August 2018. 


s was made clear by Carlos 
and Learning of Democratic 
Social Cohesion (COES)? in 


Additional Important Topics for the Latin American Research Agenda 


As described above, the research carried out with ICCS data can be characterized as coming from 
several disciplines. Building on these diverse perspectives, this section proposes three research 
topics whose investigation could either fill gaps found during our mapping exercise, or represent 
topics with untapped potential to address relevant issues in the current context of Latin America. 


Promote the use of information available in ICCS that has been minimally used in the past 


but is especially relevant for the region. 


Some examples would be secondary analysis covering topics such as 


authoritarianism, corruption 


in government, and attitudes toward equality of rights for disadvantaged groups (e.g., indigenous 
people, immigrants, as well as geographical inequalities). A review written in English of secondary 


analyses that had been published in Spanish would be valuable (e.g., those in the tables). That 
could parallel the recent review of such articles in English (Knowles et al. 2018). Another example 
is further investigation of the role of schools in the development of civic knowledge and in 


2 More information about this multidisciplinary research center can be found in https://coes.cl/ 
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particular the participatory opportunities that they provide. Even though there are some papers 
on these topics (see Table 2), itis clear that more research, from different disciplines, theoretical 
perspectives and analytical approaches is needed to more fully understand the role of schools 
along with their actors and processes in ensuring that young people are prepared to undertake 
their roles as citizens. This is generally important internationally, but especially in Latin America 
where there is often little space in the curriculum, and or where the democracy is at a crossroad 
in several countries of the regions questioned mainly by younger generations. 


Continue deepening our understanding of the role played by gender in relation to different 
civic outcomes. 

Results of research carried out in the region and elsewhere, indicate that the gender of the 
students plays a relevant role in relation to several civic outcomes. For example, in every country 
and in every cycle of ICCS, females tend to be more tolerant, empathic, and to participate more 
than males (Sandoval-Hernandez et al. 2018). This is probably one of the best-established 
patterns in the body of research using ICCS data, however, we still need to understand the 
social/pedagogical mechanisms that explain how and why this is the case. Research on these 
topics could produce valuable evidence to inform the design of policies and interventions aimed 
at constructing a more egalitarian society when these young people become adults. On the one 
hand, understanding how attitudes toward equality are developed in boys and girls; while on 
the other, evaluating the different ways in which genders participate in the demand for equal 
rights through conventional activities or using alternative channels. 


Continue deepening the understanding of how education systems continue to reproduce 
political inequalities. 

Similar to gender, students’ socioeconomic status is known to be one of the factors consistently 
associated with several civic outcomes. For example, it is a well-established pattern that students 
from more affluent or educated families tend to report higher levels of interest in conventional 
and social movement participation. Despite the fact that there are several studies focusing on 
or including this topic, we still need to understand this association, and more importantly, if and 
how we can contribute to changing the role of education from reproducing to compensating 
for political and civic inequalities. In this regard, some promising approaches are those that take 
advantage of the possibility of monitoring trends with ICCS data to focus on the intergenerational 
transmission of these types of inequalities. 


Conclusion and Discussion 


The main objective of this chapter is to describe and explore the landscape of the research results 
from using ICCS data within the Latin American region. We did so based on our personal and 
professional involvement in the field. Andres Sandoval-Hernandez had experience working at the 
research unit of IEA, moving to the University of Bath, where he has kept civic and citizenship 
education and particularly ICCS at the heart of his research interests. Daniel Miranda has a 
trajectory that started with his participation in grants about the topic and his PhD studies in 
Sociology at the Pontificia Universidad Catölica of Chile, and continued with his professional 
involvement in two research institutes within that university: Center of Measurement MIDE UC 
and the Center for the Study of Conflict and Social Cohesion. He has been co- and principal- 


investigator in a number of multi-year research projects that make extensive use of ICCS data. 


Our experience working with IEA data and the mapping exercise included in this chapter allowed 
us to identify what we believe are the most important successes and also the barriers to increasing 
the impact of ICCS in the policy and practice discussions of the region; as well as providing some 
recommendations that could help to address them. The barriers include the following: 


A limited number of researchers who possess the expertise to analyze and interpret data from 
large-scale assessment data. 
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As was Said before, one of the positive outcomes of the participation of Latin American countries 
in ICCS was the emergence of a network of researchers in the region. Nevertheless, there is still 


much to be done. We identified only 36 peer-reviewed scho 


arly articles, chapters, and books 


for inclusion in our landscape, and those works were co-authored by about 30 individuals. This 


is a thri 
educati 


but it a 


would allow them to analyze and interpret the results of large-scale assessments like 


ving community of researchers committed to the imp 
on in Latin America, but much more could be done i 
extends across the region. As Torney-Purta et al. (2010) recognize, t 
civic an 
before, 
psycho 


rovement of civic and ci 


tizenship 


n terms of building capacity that 
he interdisciplinary nature of 
d citizenship education tends to create a fragmentary picture of the field. As men 


tioned 


researchers using ICCS data work in diverse fields including political science, educational 
ogy, sociology, and social studies education. This interdisciplinarity represents a strength, 
so means that many of the people interested in the topic lack the 


technical training that 


CCS: 


Lack of technical documentation and a limited number of training events available in Spanish 


The communications team at IEA does a great job at dissemin 


and the Research and Analysis Unit does an excellent job at off 


in secondary analysis techniques of 


a very 


Academies in collaboration with the 
English as the main language of 
merica since English is not widely spoken in the region. Accordi 


use En 
LatinA 
Index 


average 
average person in Latin America 


their datasets. Good exam 


comprehensive Training Portfolio, the video tutorials ava 


Education First 2018), Latin 
English proficiency score 


A still smaller percentage would be 
with a complex sample and assessment design. 


nstruction. This is a major 


America is the weakest of a 


Educational Testing Service (ETS 


atin 


ilab 


| re 


g their studies and results, 


ering options to build capacity 
ples of this are the offering of 


e on the web, and the IERI 
.3 All these efforts, however, 


barrier for many researchers in 


ng to the English Proficiency 
gions in the world, with an 


barely surpassing the low proficiency cut-off. That is, the 
cannot read a newspaper or understand a TV show in English. 


able to understand statistical training about analyzing data 


The following are recommendations that we believe could contribute to overcoming the barriers 
described above: 


Develop open-access software to analyze large-scale assessment data 


Similar 


Statisti 


The ID 


job at making tools for analyzing 
(International Database) Analyzer, Data Visualizer, and the NCES 


only be used 


to the technical documentation and training events, the | 


arge-scale assessmen 


cs) Data Explorer are good examples of this. The Data Visua 
to produce only very basic visualizations of descriptive statistics; 
with a limited number of studies (i.e., PISA, TIMSS, 


B Analyzer offers greater fle 


analyses (e.g., 
that it uses ei 
software pac 


be expected, ma 


inear and logistic regressions). The main limitat 
ther SPSS (e.g., IBM 2013) or SAS (e.g., SAS 2012) as its statistical engine. Both 
ages fall in the category of commercial software with 
ny individuals and institutions in the region canno 


to tools like th 


e IDB Analyzer. 


xibility and the possibility of 


tion of 


(Na 


run 


EA has been doing a very good 
ts data freely available. The IEA’s IDB 


tional Center for Education 
izer, however, can be used 


the NCES Data Explorer can 


PIRLS, PIAAC, and TALIS). 
ning slightly more complex 


the IDB Analyzer is, however, 


expensive licenses. As can 
t afford to purchase access 


Establish partnerships among national governments, international organizations, and 


academic institutions in Latin America. 


We believe that these kind of partnerships can be the vehicle to develop solutions to several of 


the issues described above. For example, some of the | 


EA materials are already being translated 


into Spanish by organizations in Latin America. This practice could be conducted in a systematic 


3 More information about the IEA's training activities can be found here: https://www.iea.nl/research-services/training 


271 


fashion t 
countries (e.g. 
the Quality of 


American 


hroug 


, 


h agree 
the Co 
Educat 
Latin America (e.g., O 
Develop 


via the IEA’s institut 


repositories of resea 
Learning, Engagem 


These par 
strategy in 
ana 


nd 


Another prom 
r 
n 


Latin Ameri 
challenges in 

theoretical ap 
This is especia 


the 
ysis of secondary da 
combined with 
with ICCS data 
OREALC/UNESCO (i.e., t 
a 


necessary to of 
interested in the region. 


tnerships cou 
ion. IEA has developed a sound structure 
ta from large-scale assessments. The structure developed by IEA could be 


training programs. In a recen 


pre 
pro 
lly 


reg 


ffer high-quali 


INFL 


REALC/UNES 


ment Bank). The 
tional channels or through o 


rch data, like 
t, and Action 


UENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


ments between the IEA and its partner institutions in Latin American 
ombian Institute for 
tion), or with other international organizations with a strong presence in 


Educational Evaluation or the Chilean Agency for 
CO, the Organization of Ibero-American States, or the Inter- 
translations of these documents could then be disseminated 
ther institutions dedicated to providing centralized 


d also consi 


the initiative housed at the University of Michigan, Civic 
Data Sharing (CivicLEADS).* 
titute a platform for the establishment of a capacity-building 


for the delivery of training on the 


the expertise existing in 
. There are also mechanisms developed by other international organizations like 
he capacity building strategy developed for the Regional Comparative 
Explanatory Study [ERCE]). These or similar partnershi 
ty training in 


ising partnership co 


the region (especially the network of researchers working 


ps could provide the conditions 
Spanish and in locations more accessible to those 


uld include the agencies in charge of developing teacher 


t review of the initial teacher education programs in citizenship 
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position to provide 
since it collects extensive information on teaching practices associated with 
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This methodological design would expand 
with secondary analysis. 
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their socioeconomic conditions, or a schoo 


in the region. 


violent social environments). Then, qualitative case st 
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tterns. Furthermore, 


the empirical evidence needed to address this challenge 
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es of studies focusing 
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a 
on the identification of successful teaching practices in this area based on analyses of ICCS can 
b in, for example, Trevino et a 


. (2017) and Carrasco and Irribarra (2018). 


regional research projects 


quantitative or qualitative. 


the range of questions that can be answered only 


For example, an initial secondary analysis of ICCS data could be used 


ts who perform better than expected according to 
reporting low-levels of violence despite being in 
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these projects could be configured in a way 
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4 More information about this project can be found here: https://www.icpsr.umich.edu/icpsrweb/content/civicleads/ 


index.html 


5 During the publication process of this volume, a new piece of software has been released. This software is open- 
source, has a user-friendly interface, and has been specifically designed to analyze ILSA data. More information can 
be found here: http://ralsa.ineri.org/ 


LANDSCAPE AND RECENT DEVELOPMENTS ACROSS LATIN AMERICAN REGION 273 


Develop user-friendly, open-source software to analyze large-scale assessment data’ 


The development of a training strategy for the Latin American region could be coupled with 
the development of open-source, user-friendly software alternatives for the analysis of data. It 
is important that open-source software be free. The adoption of open-source software would 
contribute to eliminating the economic and technical barriers that currently affect an important 
proportion of researchers in the region; the software alternatives currently available for analyzing 
international large-scale assessment data require the user to buy expensive licenses of proprietary 
software. Open-source software is not only free to use, but also free to distribute and modify. 
The fact that this source code is accessible and is continuously being employed by a large 
community of users results in the code being secure and stable. Furthermore, because it uses 
open standards accessible to everyone, it does not have the problem of incompatible formats, 
or platforms that exist in proprietary software. That means that it can be used in Windows, 
Mac, or Linux computers. The main disadvantage of open-source software, however, is that it 
is not straightforward to use. Open-source operating systems like Linux and software packages 
like R require considerable effort to master them. So, for this recommendation to work in an 
efficient manner, it would be advisable to develop a user-friendly interface to facilitate the use 
of open-source software. Specifically, R could be used for the analysis; a user-friendly interface, 
similar to the IDB Analyzer, should be developed to make it possible to use it without having 
programming knowledge. 


Include concepts that have proved to be relevant for Latin America in subsequent 
international instruments of ICCS 


Examples of this are the items and scales about authoritarianism and tolerance toward ethnic 
minorities. As Bonikowski (2017) points out, scholarly and journalistic accounts of the recent 
successes of radical-right politics in Europe and the United States, including the Brexit referendum 
and the Trump campaign, tend to conflate three phenomena: populism, ethno-nationalism, and 
authoritarianism. Additionally, changes in political participation disengaging from traditional 
c 
O 


hannels and using alternatives even violent channels in several Latin American countries, and in 
ther regions of the world, bring several questions about the future of democracy. Bringing more 
tailored attitudinal measures into the studies would provide invaluable information to address 
issues that are relevant across regions of the world, while taking advantage of the knowledge 
already developed in these areas by Latin American researchers. 


Summary 


n summary, in describing the landscape of the research that has built on the ICCS data collected 
in Latin America, we have identified a small but thriving community of researchers committed 
to the improvement of civic and citizenship education in the region. We have identified what 
we consider to be the main barriers to increasing the impact of ICCS in the policy and practice 
discussions of the region. These include the limited number of researchers with the expertise 
to analyze and interpret large-scale assessment data, the disconnection between the teacher 
training programs and the empirical evidence provided by studies like ICCS, as well as the lack of 
technical documentation and the limited number of training events available in Spanish. There is 
also the lack of an open-access, user-friendly software to analyze large-scale assessment data. 


While this list of barriers appeared quite daunting, we have also identified some possib 
strategies to overcome them. These strategies depend heavily on the community of researchers 
that has been developed as a result of the participation of Latin American countries in CIVED 
and the two cycles of ICCS. This community includes not only academics from a variety of 
disciplines, but also policymakers and practitioners. Current and new partnerships between 
national governments, international organizations, and academic institutions could constitute a 
platform for the establishment of a capacity-building strategy in the region. This initiative would 
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opment of open-source, user-friendly software to analyze data from large-scale 


assessments, along with the training of new experts in the field. The new experts in the field 


would include those who are content experts, but lack the technical expert 


data; but also those who have the statistical expertise, but lack the know 


tise to analyze ICCS 
ledge in the field of 


civic and citizenship education, or they lack the experience in communicating to non-specialist 


audiences. Final 


y, long-term partnerships could also allow further collaboration between the 


agencies in charge of initial teacher education programs, and the researchers working on the 
identification of successful teaching practices. 
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CHAPTER 23: 


Reflections on the Development of the IEA Civic 
and Citizenship Education Studies 


Wolfram Schulz 


Abstract This chapter discusses the content, design, and methods of the three IEA studies of civic 
and citizenship education. It focuses on the changes made between each of these studies and 
the contexts for this learning area. The IEA Civic Education Study (CIVED) in 1999 was developed 
soon after the transition to democracy in many participating countries; threats to civil society in 
the early 2000s such as terrorism influenced the International Civic and Citizenship Education 
Study (ICCS) in 2009. The design of ICCS in 2016 responded to the increasing importance of 
social media in civic engagement, the growth in awareness of global and environmental issues, 
as well as the recognition of school as a context for social interaction. Starting in 2009 ICCS 
studies have implemented regional modules including questions covering topics of specific 
interest in Asia, Europe, and Latin America. Changes were made in the design, which make it 
difficult to compare results across time. Examples are the introduction of rotated booklets for 
the civic knowledge test or the change in the sampling strategy for the teachers. The selection 
of item material in each study followed an exhaustive process of reviews and discussions among 
IEA country representatives (as well as experts and international committee members). 


Introduction 


IEA has an impressive history of studies of civic and citizenship education and remains the 
only organization conducting regular studies dedicated to this learning area. The first IEA civic 
education study was part of the organization's six-subject study and collected data from ten 
countries in 1971 (Torney et al. 1975). It was nearly 30 years before the organization mounted 
another comparative study of this learning area, the second IEA Civic Education Study (CIVED) 
implemented in 1999. It collected data from 14-year-olds in 28 countries (Torney-Purta et al. 
2001). CIVED also collected data from upper-secondary students in 16 countries (Amadeo et 
al. 2002). In 2009, IEA conducted the first in a cycle of IEA International Civic and Citizenship 
Education Studies (ICCS) (Schulz et al. 2010), which after a second implementation in 2016 
Schulz et al. 2018a) is currently in its third study cycle with data collection scheduled for 2022. 


The changes following the fall of communism in Europe prompted IEA to begin the development 
process for CIVED. Starting in 1994 the study’s Steering Committee developed a civic knowledge 
and skills test and a questionnaire measuring civic and political attitudes and perceptions. 
Background information questions were included as well as items measuring open classroom 
climate (which originated with the 1970s study). Most previous IEA studies (such as the Trends in 
nternational Mathematics and Science Study [TIMSS]) had a primary focus on the measurement 
of knowledge and skills, and attitudes were measured as part of the contextual data collection. 
An international center at the Humboldt University of Berlin and IEA's central organization 
provided technical assistance. While funding was limited, pre-testing was essential due to the 
newness of this subject area in IEA’s range of assessments at that time. 


The CIVED study defined a largely new subject for educational research, responded to 
considerable policymaker interest in the field (especially in Eastern Europe), and provided countries 
a basis for developing education programs that addressed civic knowledge, civic attitudes, and 
civic participation (as discussed in other chapters). It served as the basis on which cyclical studies 
would later be built. 
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ICCS 2009 was designed as a new baseline study. It contained a range of similar questionnaire 


it included linkage items to CIV 


measuring changes 


and design features, and (c) included items/scales that 
since the nature of civic and cit 


items, a modified test design with rotated booklets to increase the coverage of content, and 


D. A major purpose of the subsequent ICCS cycles has been 


in cognitive civic performance over time. Therefore, ICCS has (a) maintained a 
similar conceptual framework for the test/assessment, (b) used comparable population definitions 


challenges, new aspects appear 


changes to instrum 
include updated co 


ents and design may lead to 
ntent. 


tizenship education changes with 


can be compared across time. However, 


alterations in contexts and 


in each cycle and some are replaced. While more substantial 


incomparability across cycles, it is important to 


This chapter focuses on the types of changes implem 
civic and citizenship ed 


ented between the three IEA studies of 
ucation from the late 1990s to 2020. Content-related changes concern 


the conceptual framework and the specific topics covered. Design-related changes concern 
the definitions of populations assessed (students and teachers), and the specific instruments 


administered. Method-related changes concern the way data were co 


lected, scaled, and analyzed. 


There were more substantial changes between CIVED 1999 and ICCS 2009 than between 


the two cycles of | 


to monitor changes over time using comparable instruments. How 
constructs originally developed for CIVED remain represented in 


CCS. IEA decided to create 


a base 


attitudes toward immigrants’ rights, attitudes to 
support for norms of conventional and social movement citizenship action). 


This chapter first ou 


next cycle of ICCS 


tlines changes between CIVE 
the two first cycles of ICCS. Fur 


ne study s 


tarting with ICCS 2009 and 
ever, many of the attitudinal 
the ICCS instruments (e.g., 


ward women’s righ 


ts renamed gender equality, 


D and ICCS, and then reviews changes between 


thermore, the 


chapter considers expected changes for the 
in 2022. This includes a transition to computer-based delivery, which is a 


challenge for all international studies (that started with paper-based data collection). Finally, there 
tension between comparability across studies and the need for innovation. 


is discussion of the 


From CIVED 1999 to ICCS 2009 


The development of ICCS in its first cycle had many similarities to the CIVED 1999 study but 
was conceptualized as beginning a cycle for the future. Therefore, ICCS 2009 introduced new 


elements in conten 
of results between 


CIV 


t, design, and methodology. This limits the possibilities for direct comparisons 
D and ICCS. Some changes were adaptations that had already been 


successfully implemented in other studies, but not previously applied in CIVED due to budget 


restrictions. There were also many similarities across the studies in purpose, conceptualization, 


and implementation. 


Content-related Changes 


At the outset of pla 


e Strengthen aspe 


e Place greater en 
edge. 


The ICCS 2009 fra 
framework for CIV 


cts related to participation; 


nclude a wider range of content in the cogn 


nphasis on reasoning and a 


mework (Schulz et al. 2008 


dispositions for engagement were seen as influen 
in accord with ecological systems theory (Bronfenbrenner 2004; Neal and Neal 2013) and 
theories of situated cognition (Anderson et al. 2000). This is reflected in the ICCS contextual 
framework (Schulz et al. 2008; Schulz et al. 2016), which sees civic-related learning outcomes 


ED 1999. For example, students’ acquisiti 


itive test; and 
pplying when asse 


nning for ICCS 2009 the conceptual framework of CIVED was broadened to: 


ssing students’ civic knowl- 


included explicit references to the conceptual 
on of knowledge, attitudes, and 
ced by connections with their civic communities, 
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as influenced by characteristics of individual students, their home and peer contexts, school and 
classroom contexts, and also wider community contexts. 


CIVED 1999 (Torney-Purta et al. 2001; Schulz and Sibberns 2004) conceptualized the content of 
relevant outcome variables based on a collection of case studies from 24 participating countries 
(Torney-Purta et al. 1999) and through a consultation process with country representatives 
during the mid-1990s. The study developed the following content categories: 


E 


e Democracy/Citizenship (subdomains: democracy and its defining characteristics; institutions 
and practices in democracy; and citizenship—rights and duties) 

e National Identity, Regional and International Relationships (subdomains: national identity 
and international/regional relationships) 

e Social Cohesion/Diversity. 


The ICCS framework (Schulz et al. 2008) defines civic and citizenship content as related to the 
following content domains: 


e Civic society and systems (subdomains: citizens; state institutions; and civil institutions) 

e Civic principles (subdomains: equity; freedom; sense of community; and, since ICCS 2016, 
rule of law 

e Civic participation (subdomains: decision-making; influencing; and community participation) 

e Civic identities (subdomains: self-image and connectedness). 


Many content aspects of the CIVED domain of democracy/citizenship can be mapped to the 
ICCS domain civic society and systems. Likewise, aspects related to the second CIVED domain of 
national identity/international relations can be regarded as part of the fourth ICCS domain, civic 
identities; the third CIVED domain of social cohesion/diversity has commonality with the second 
ICCS content domain, civic principles. ICCS emphasized the importance of civic participation by 
assigning a specific content domain. 


The rationale for emphasis on participation resulted from concerns about low levels of 
engagement among young people, changes in patterns of citizenship participation, and the 
observation that civic curricula were increasingly including content related to active forms of 
citizenship in addition to those related to learning civic knowledge. This broadening of scope is 
also reflected in the studies’ names. The current IEA study is described as a civic and citizenship 
education study, while the two prior studies were referred to as civic education studies. However, 
the distinction between correct answer keyed cognitive items in a test and attitudinal/participation 
items without correct answers in a questionnaire has been maintained across the studies. 


In CIVED 1999 cognitive test items measured either content knowledge or skills in interpreting 
civic-related information such as a mock election leaflet or political cartoon. Two sub-scales and 
a total scale were reported. The broadening of the ICCS civics and citizenship framework to 
include cognitive processes of applying knowledge to reach conclusions defined two cognitive 
domains—knowing and reasoning and applying. These resemble Anderson and Krathwohl’s (2001) 
distinction between remembering or recalling information and processing content in applying it 
to new situations. These two sub-dimensions were highly inter-correlated and we decided not 
to reported sub-scales of civic knowledge in ICCS. However, it remains an important distinction 
in cognitive processing of civic-related information (Schulz et al. 2011; Schulz et al. 2018a; 
Schulz et al. 2013). 


With regard to outcomes measured by the student questionnaire, CIVED 1999 distinguished 
between concepts, attitudes, and actions. For ICCS 2009, there was an explicit distinction 
between values, attitudes, behavioral intentions, and behaviors. The distinction between values 
and attitudes was between more enduring and deeply-rooted beliefs and those more focused on 
specific issues and potentially changeable (Schulz et al. 2008). The second distinction was made 
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Table 1: Common student questionnaire content aspects for CIVED, ICCS 2009, and ICCS 2016 


Content 


CIVED 1999 


ICCS 2009 ICCS 2016 


Reports on discussions of civic issues 


A 


B 


Students’ interest in civic issues 


Reports on civic participation in the community 


Reports on civic participation at school 


Percep 


ions of open c 


assroom climate 


P| P| >| > 


w 


Percep 


ions of studen 


s' influence at school 


Ww) DW] ww] wo] w| w 


Percep 


ions of civic learning at school 


Percep 


ions of studen 


-teacher relations at school 


Experiences of verbal and physical abuse at school 


Percep 


ions of studen 


interactions at school 


Valuing student participation at school 


= Wenkel Ea) 


Attitudes toward the role of government 


Perceptions of democracy 


Perceptions of good citizenship 


Endorsement of gender equity 


Endorsement of equal rights for ethnic/racial groups 


w| w| w| w 


wW|w|w|n 


Attitudes toward rights of anti-democratic groups 


Endorsement of immigrant rights 


Attitudes toward country 


Trust in civic institutions and groups 


Internal political efficacy 


w| w| wo] w 


External political efficacy 


P|bP|P|b|P|>|P|>|b>P|P|>|> 


Support for political parties 


Citizenship self-efficacy 


Expected participation: Legal activities (protest) 


Expected participation: Illegal activities (protest) 


Expected electoral participation 


Expected active political participation 


DP» > 


Endorsement of religious influence in society (optional) 


wD) m/w; an; w| w| Ww 


w/w w| N|N|u 


Notes: A = Version developed for CIVED 1999; B = version developed for ICCS 2009; C = version developed for ICCS 2016. 
* Only included in the European regional questionnaire. 
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denoted with “A,” those for ICCS 2009 with “B” and those for ICCS 2016 with “C” In cases 
where item sets are entirely comparable, the corresponding pairs of cells are marked in grey. 
However, as ICCS changed the questionnaire format, direct comparisons between CIVED and 
CCS are not recommended. ICCS 2009 was established as a new baseline study, and ICCS 2016 
has directly comparable items and included some IRT scales that were equated across cycles to 
allow comparisons at the scale level. 


easuring region-specific aspects of civic and citizenship education was a new content-related 
feature of ICCS. Regional student instruments gathered data of particular relevance in the 
corresponding geographical region for the European countries (Kerr et al. 2010), for Latin 
America (Schulz et al. 2011), and for Asia (Fraillon et al. 2012). The European and Latin American 
instruments for ICCS 2009 included short sets of cognitive test items specific to the region. 
The European and Latin American countries participating in ICCS 2016 administered additional 
student questionnaires (Losito et al. 2018; Schulz et al. 2018c). There were too few participating 
countries in the Asian region in 2016 to sustain a regional component. 


The cognitive test portions of regional instruments were difficult to develop, both from a 
conceptual and a measurement perspective. The European cognitive test was devised as an 
instrument to measure "knowledge about Europe and its institutions" and was limited to very 
basic factual knowledge. The resulting test showed poor psychometric quality and results were 
only reported at the item level (Kerr et al. 2010; Schulz et al. 2011). The Latin American cognitive 
test had better psychometric quality. However, its content was conceptually very similar to 
the international civic knowledge test. Therefore, these items were used to supplement the 
international test results with region-specific content but not to derive a region-specific civic 
nowledge scale (Schulz et al. 2011). For ICCS 2016, the regional student instruments only 
included questionnaire-type item material. Some Latin American knowledge items were adapted 
and moved into the international cognitive assessment. 


Design-related Changes 


Given the conceptualization of ICCS 2009 as a new baseline study, there were design-related 
changes from CIVED. These included changes to the population of students, the test design, 
and the introduction of additional instruments and delivery modes. 


For CIVED 1999, the target population was defined as students enrolled in the grade that had 
the highest proportion of 14-year-olds. As this population definition was different from other 
IEA studies, for ICCS the student population was defined as students in the grade representing 
eight years of schooling, provided that the national average age at the time of the survey 
was at least 13.5 years. In a number of countries participating in both CIVED 1999 and ICCS 
2009 the target grade changed; some participants opted for an additional survey in the upper 
adjacent grade, which allowed comparisons for content knowledge based on the set of CIVED 
link items included in the ICCS 2009 test (Schulz et al. 2010; Schulz et al. 2011). However, the 
basic (cluster) sampling design with schools selected proportional by size and intact classrooms 
within schools remained unchanged across studies (Schulz and Sibberns 2004; Schulz et al. 
2011; Schulz et al. 2018b). 


CIVED 1999 included a classroom-based survey of teachers of civic-related subjects. National 
centers identified up to three subjects where content of the CIVED test of civic knowledge was 
taught and were requested to survey the teachers of these subjects (Torney-Purta et al. 2001; 
Schulz and Sibberns 2004). The resulting samples of teachers were not necessarily representative 
of the overall teacher populations due to varying procedures used to identify the civic-related 
subjects. This concern was among the reasons for changing the ICCS teacher survey design. 
Even more important was the perspective that civic and citizenship education is likely to be 
influenced by the entire school context and that all teachers contribute to the civic learning of 
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young people regardless of their subject area. Consequently, the ICCS teacher questionnaire 
was administered to a sample of all teachers teaching at the target grade at each of the selected 
schools. Teacher data could also be analyzed by aggregating 


them as school-level indicators. 


In order not to neglect data about the teaching of civic-related content, ICCS offers an option 
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Method-related Changes 


Due to resource restrictions, CIVED 1999 could not implement a number of IEA’s measures 
for quality assurance internationally. However, field operation manuals encouraged countries 
to implement quality assurance measures such as phone calls (or visits) to schools, and national 
centers were requested to complete a survey documenting compliance with operational 
procedures (Schulz and Sibberns 2004). Translations for the main survey were undertaken by 
national centers and then submitted for verification by independent language experts. 


n ICCS 2009 and 2016, when appropriate funding was available, IEA organized an international 
quality monitoring where independent observers visited 10% of sampled schools to monitor 
the appropriate data collection procedures (Schulz et al. 2011; Schulz et al. 2018b). Translation 
verification was implemented prior to both the field trial and main survey, using professional 
agencies, and final instruments underwent thorough layout verification checks. Results from this 
review were discussed with national centers to improve the quality of the survey instruments 
(Schulz et al. 2011; Schulz et al. 2018b). 


While CIVED 1999 limited its data collection instruments to closed item formats, ICCS introduced 
open-ended questions where students had to write answers that were coded by national centers. 
To improve the measurement of socioeconomic background, students were asked to provide 
a short title for the jobs of their parents or guardians followed by a short description. Answers 
were coded using the international ISCO-08! classification (International Labour Organisation 
2007) and converted into scores following the ISEI? scheme (Ganzeboom et al. 1992). The 
resulting indicators contribute substantially to the measurement of parental socioeconomic 
background, which is related to learning outcomes in civic and citizenship education (Brese and 
Mirazchiyski 2013). 


— 


The cognitive assessment developed for CIVED 1999 included only items with multiple-choice 
formats, which do not require complex scoring rules. For ICCS we also developed open-ended 
formats to gather data about complex cognitive reasoning, which is harder to capture with 
pre-defined answer formats. Therefore, ICCS includes open-ended items constituting about 
10% of the test items, for which written answers were coded according to international scoring 
guides. These items were well suited to measure cognitive reasoning and applying knowledge; 
furthermore, they substantially contributed to the measurement and description of higher levels 
of civic knowledge. While challenging to develop and consistently score across participating 
countries, the open-ended items showed good psychometric characteristics (with acceptable 
evels of cross-national measurement invariance) and satisfactory inter-scorer reliability (Schulz 
et al. 2011; Schulz et al. 2018b). 


For the scaling of CIVED 1999 data, IRT-based modelling using the Rasch (one-parameter) 
model was applied to derive the civic knowledge scale and the two sub-scales reflecting content 

nowledge and skills in interpreting political communication. Given resource limitations in CIVED, 
maximum likelihood estimates (MLE) were used as cognitive scale scores (Schulz and Sibberns 
2004). For ICCS, we had the resources to apply plausible value methodology (von Davier et al. 
2009)—an approach also used in other IEA studies such as TIMSS or PIRLS. 


CIVED 1999 was the first international study where IRT-based modelling, here using the Rasch 
Partial Credit model (Masters and Wright 1997), was applied to the scaling of questionnaire items. 
This approach had the advantage of a better handling of missing responses to the attitudinal 
questions and provided a way of describing scale scores by relating scale scores to expected 


1 ISCO = International Standard Classification of Occupations. 
2 ISEI = International Socio-Economic Index. 


284 INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


responses to individual items (Schulz and Sibberns 2004). With some modifications,? this 
approach was also applied in ICCS. An IRT score in one study can only be compared to a score 
in another study if the scale scores have been equated based on sets of unmodified items. For 
ICCS 2016, some of the student questionnaire scales were reported on the same scale metric 
and may be compared across the two cycles. ICCS routinely implements extensive in-depth 
reviews of cross-national validity and measurement invariance during the development stages 
(Schulz 2009; Schulz and Fraillon 2011; Schulz et al. 2018b). 


From ICCS 2009 to ICCS 2016 


CCS 2009 was designed as a baseline study for future ICCS cycles. One primary goal of 
CCS is to monitor trends in civic learning outcomes over time for countries that participate in 
more than one cycle. In ICCS 2016, 19 of the 24 countries or sub-entities participating had 
participated in ICCS 2009. To allow measurement of changes, about half of the ICCS 2016 test 
items were secure item material from the previous cycle. Furthermore, many items in the student 
questionnaire were kept with identical wording in ICCS 2009. There are 13 equated international, 
two European, and four Latin American questionnaire scales available for comparisons between 
CCS 2009 and 2016. 


While it was possible to accommodate a wide range of comparable material in the ICCS 2016 
instruments, there was also a need to refine the framework and update the instruments to 
encompass new developments. At the outset of the second ICCS cycle, we defined three focus 
areas for new items: 


e Environmental sustainability in civic and citizenship education: In many societies, the po- 
tential impact of human activity on the environment (in particular the global climate) and en- 
vironmental sustainability had become key issues. Responsible citizenship was increasingly 
viewed as including regard for environmental protection, a requisite for future sustainable 
development (Dobson and Bell 2006; Hayward 2006). 

e Social interaction at school: Reviews of civic and citizenship education curricula across 
countries provide evidence that at the outset of the 21st century a large number of coun- 
tries place emphasis on non-formal aspects of civic learning through participation and en- 
gagement or social interaction at school, and research had increasingly recognized the im- 
portance of relationships within the school community. Some of these were positive and 
others related to conflict and bullying (Dijkstra and de la Motte 2014; Scheerens 2011). 

e The use of new social media for civic engagement: There was growing evidence about the 
importance of new social media and this has been found to have a profound effect on civic 
engagement among young people (Anduiza et al. 2012; Banaji and Buckingham 2013). 


=y 


<. 


Two further areas were identified that had been included in previous IEA surveys as deserving 
more explicit acknowledgement in the ICCS 2016 assessment framework: 


e Economic awareness as an aspect of citizenship: Some believe that students’ economi 
awareness can be conceptualized as a broad awareness of the ways in which economi 
issues influence citizenship without referring to financial or economic literacy (Citizenship 
Foundation 2013). 

e The role of morality in civic and citizenship education: Concepts of morality and character 
are often invoked in relation to outcomes of civic and citizenship education programs, the 
assessment framework provides scope for this in the ICCS 2016 instruments (Oser and 
Veugelers 2008). 


f? 


O 


3 ICCS used weighted likelihood estimates (WLE) (Warm 1989) instead of maximum likelihood estimates (MLE), used 
a different reporting metric, and also used a slightly different method for describing questionnaire scale scores in 
order to (1) make the questionnaire scale metric consistent with the one for the cognitive scale (in CIVED: 10/2 
corresponding to 100/20, in ICCS: 50/10 corresponding to 500/100), and (2) to provide a more robust way of 
mapping scale scores to item responses. 
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There were only minor changes to the overall structure of the framework as a result of this 
conceptual refinement. However, there was some more explicit recognition of terms and key 
concepts important to these new areas (see Schulz et al. 2016). New material was developed 
covering the focus areas to capture relevant aspects. 


A challenge was to balance the preservation of material to measure changes over time with 
the development of new material. While rotated booklet design for the cognitive assessment 
facilitated this, there were limitations in the length of the student questionnaire covering 
contextual information, attitudes and engagement. The ICCS 2016 student questionnaire was 
of 40 minutes duration, administered after the 45-minutes test of civic knowledge. In countries 
in Europe and Latin America it was followed by the 15-minute regional questionnaires. 


In 2016 question sets gathered data in three new focus areas: students’ use of internet and 
social media for engagement, perceptions of social interactions at school, and perceptions of 
threats to the world's future. Some ICCS 2009 student questionnaire items were deleted: support 
for political parties, internal political efficacy, perceptions of students’ influence at school, and 
students’ interest in different areas. 


The item set measuring students' endorsement of immigrant rights was included in the European 
questionnaire but no longer in the international questionnaire. However, during the time of the 
ICCS 2016 administration, there was a dramatic increase in migration, resulting from violent 
conflict in African and Middle-Eastern countries as well as in Latin America (due to the political, 
economic, and social crisis in Venezuela and some Central American countries) and in ICCS 2022 
this scale will be reinstated in the international instrument. 


Changes were also made to the ICCS 2016 student questionnaire. The question gauging 
students’ perceptions of democracy was revised by developing an item set asking students 
about good, bad, or neither good nor bad situations for democracy in a country. These items 
8 
n 


were concentrated on what are widely assumed to be “threats,” such as “one company ownin 
all the newspapers.” New items asked about students’ willingness to consider participating i 
civic activities at school in the future. 


aterial was added to the teacher and school questionnaires about aspects of social interaction, 
use of social media or the internet at school, and school activities related to environmental 
sustainability. The national contexts survey was also amended to ask about these topics. 


Looking Ahead: Going into ICCS 2022 


As the development of the next cycle of ICCS with a data collection scheduled for 2022 has 
commenced, it is timely to reflect on the challenges for this fifth IEA study of civic and citizenship 
education. As for ICCS 2016, in collaboration with national centers and experts, the international 
research team developed new focus areas and conducted a thorough review of existing item 
material. Once again, it will be important to balance material relevant to current challenges with 
the requirement for measuring changes, for which the same measures across cycles are required. 


ICCS 2022 will include material to assess aspects related to sustainable development, students 
use of digital technologies for engagement, students' perceptions of diversity, and students' views 
of the political system. Furthermore, the study will put greater emphasis on issues related to global 
citizenship, an area which had already been part of earlier IEA studies of civic and citizenship 
education. All these themes respond to recent developments and continuing challenges (such 
a 
G 


s growing concerns about global sustainability, globalization, increasingly diverse societies, 
hanges in how citizens obtain information and engage, or their alienation from democracy). 
In view of more recent changes that occurred during the development of the study cycle in 
2020, ICCS 2022 will also address civic-related aspects related to the COVID-19 pandemic 
such as students’ perceptions of the appropriateness of restrictions imposed by governments 
in a national emergency. 
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The development of the IEA studies on civic and citizenship education since 1999 shows that 
there is a need to adapt study content to new developments, as well as occasionally to update 
design features and methodological aspects. Changes are essential in order to capture relevant 
information about a learning area that is strongly influenced by societal and contextual changes 
ver time. The challenge for these studies is to achieve an appropriate balance between 
onitoring changes over time and at the same time providing data that are informative and 
mely with respect to current issues and recent developments. 
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CHAPTER 24: 


A Moral Perspective on Citizenship Education 
and on IEA’s International Civic and Citizenship 
Education Studies 


Wiel Veugelers 


Abstract Citizenship education can be conceptualized within different frameworks or perspectives 
about the meaning of citizenship. These differences become more important when the focus is 
on educational policy and practice. The chapter first discusses a national concept of citizenship 
and then the concept of global citizenship. This chapter conceptualizes three different types 
of national citizenship: adapted, individualized, and critical-democratic. Research into global 
citizenship also shows three types: an open global citizenship with an emphasis on cultural 
openness; a moral global citizenship focusing on the well-being of humanity; and a social-political 
8 
8 
h 


obal citizenship aimed at greater social justice. These distinctions emphasize the influence of 
obalization on the articulation of civic and citizenship education. Global citizenship focuses on 
uman rights principles as moral guidelines for improving the world; national citizenship focuses 
on strengthening national culture. This chapter demonstrates the relevance of moral values for 
civic and citizenship education. lt also presents suggestions for including moral values in the 
conceptual framework of the IEA’s International Civic and Citizenship Education Study (ICCS). 
To that end, it concludes by suggesting a new definition of education for citizenship. 


Introduction 


The concept of citizenship appears in policy, in research, and in social practice and has become 
central in contemporary policy discussion. Traditionally citizenship was only linked to the 
political domain of one's country (Isin and Turner 2002); in recent decades the concept has 
been “broadened” and “deepened” (Veugelers 2011a). It is “broadened” because the concept is 
no longer linked only to the nation state, but also to regional identities such as the European 
Union and even to the world as a whole. By “deepened” we mean that the concept of citizenship 
pertains not only to the political level of society but also in the social and cultural domain. This 
deepening makes citizenship a normative and therefore a contested concept. In this process of 
deepening, the concept of citizenship becomes linked to moral development. The concepts of 
citizenship and of citizenship education, when viewed in their global perspectives, have diverse 
meanings (Veugelers 2011b; Oxley and Morris 2013; Goren and Yemini 2017). This is partly 
because they express the different underlying moral values that characterize different societies. 


The deepened concept of citizenship defines the kind of person society desires not only at the 
political level but also on the social and cultural levels. It is a paradox that this spread in the 
concept of citizenship and attempts to strengthen citizenship education policy is taking place ina 
period when there is a focus on a small and restrained government that leaves many activities to 
market forces. However, there is a belief within contemporary pluralist societies that ideologica 
institutions have lost much of their impact, and citizenship policy cannot be left to the market. 
Citizenship should have a robust and powerful presence in education. Many countries are 
reconsidering their policies on citizenship education and extending it into the social and cultura 
domain (Banks 2017; Schulz et al. 2018; Veugelers et al. 2017; Garcia et al. 2017; Kennedy et al. 
2018). Likewise, the number of countries participating in the cycles of International Association 
for the Evaluation of Educational Achievement (IEA) citizenship studies gives evidence of the 
extent of interest in comparisons among countries with respect to policies, results, and potentia 
reforms of citizenship education. 
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A Perspective on Citizenship Education from Research and Theory 


Citizenship education has become an i 


researchers have started empirical proj 


a solid academic field it is interesting 
come and the conceptual frameworks 


for their work. 


mportant topic in the policy of many countries, and many 
ects. As research on citizenship education is becoming 
to analyze the disciplines from which these researchers 


We present a short “genealogy” of the academic field of citizenship education over the past 
five decades. Traditionally, the academic field of citizenship studies was part of the discipline 
socialization. In the post-war period, Marshall (1964) 


of political science studying political 
shaped modern thinking about politic 


al systems and ins 


Sociologists like Isin and Turner (2002) and Bourdieu 
connection between the political arena and civil society s 


sociology of education was on the extent to which the po 


the reproduction of social and politica 


by Veugelers 201 7a). lt was extended 
building democracy through education 
Political psychologists like Torney-Pur 


| power relations a 


ta (2002) and Has 


by Giroux (1989) i 


1984) entered the field, making 


titutions along with rights and duties. 


the 


tronger. At that period the focus in the 
itical socialization process resulted in 
nd positions. Critical pedagogy added 
a transformative perspective and was based on the educational work of Freire (1985, reviewed 
nto a more comprehensive theory of 


. This made citizenship more dynamic and transformati 
te (2004) drew attention to empiri 


ve. 
Cal 


development. Philosophers, McLaugh 


contribute to citizenship development 


common values. Within the field of ed 


and emphasized personal sign 


School effectiveness research was one 
study (Torney et al. 1975) and then to t 
(reported in Torney-Purta et al. 2001). 


studies of the cognitive and affective processes 
the debate about what citizenship, democracy, and 


2005) discussing contradictions in citizenship and 


in (1992), Nussba 


involved in youngsters’ social and politi 


um (1997), and Crick (1999), ente 


cal 
red 


participation mean, and how education can 


. This was followed by the political philosophy of Mouffe 


in democracy. 


Citizenship education also became more central to policy and practice, and other disciplines 
joined the debate. Social studies researchers focused on curriculum content (Kerr 1999), 
classroom activities like deliberation (Parker 2003), and on teaching about controversial 
Hess 2009). Multicultural educators (Banks 2004) argued for attention to diversity. At the sa 
time, human rights scholars (Osler and Starkey 2010) focused attention on individual rights and 


on 


ISSUES 


me 


ucational studies and pedagogy, Westheimer and Kahne 


2004) investigated service learning taking place during civic education experiences and Bie 
2011) explored “subjectification” becomi 


contributor to the i 


he IEA Civic Educati 


sta 


ng a subject, in relationship to citizenship educati 
fication instead of socialization. 


on 


on Study (CIV 


tiation of the first IEA civic educati 
ED) conducted in 1999 


on 


Of even more importance in initiating that study was the 


desire by the Eastern European countries that had recent 
nion to better understand processes of 
easuring students’ attitudes and partici 


U 
m 
disciplinary groups of scholars and we 
C 


was working in the realm of moral educ 


(2008), and Oser and Veugelers (2008), who wer 


re repeated and ex 
itizenship Education Study (ICCS) (Schu 
these three large-scale international assessments of civi 
the chapters in this volume and frames this chapter as w 


At about the same time these studies were being published, an interdisciplinary group of scho 


ell. 


y become independent of the Soviet 
civic education in democracy. The questionnai 
pation were formulated by cross-national and cross- 
tended in the International Civic and 
tz et al. 2010; 2017). Understanding the impact 
c education is the primary subject 


[ES 


of 
of 


aS 


ation. These included Haste (2004), Althof and Berkowitz 


e linking morality with society and the political 


domain. They emphasized that moral values are not abstract notions but embedded in societal 


contexts and political power relations. Po 


st-colonial studies (Andreotti 2011; Torres 2017) went 


beyond a Western perspective on the conceptualization of citizenship and of citizenship education 
rs to emphasize social justice. A specific Asian perspective 


and joined the attempts of many schola 


A MORAL PERSPECTIVE ON CITIZENSHIP EDUCATION 293 


has been examined by scholars like Kennedy et al. (2010) and Sim (2011). They argued that an 
Asian perspective places more emphasis on attachment to local and regional traditions. The 
concern for sustainability has also become part of citizenship: the citizen and their surroundings 
should become not only democratic but also sustainable into the future (Gaudelli 2016). All these 
researchers, focusing on a particular knowledge base and their own epistemological perspective, 
have contributed to citizenship education studies. It is now a dynamic field framed by several, 
sometimes diverging, social, moral, cultural, and political perspectives. 


This overview demonstrates that as citizenship education became the subject of policy and 
research some distinctions were made in the underlying conceptualization. We first will 
demonstrate this for more national aspects of citizenship and then for aspects of global citizenship. 
National citizenship is more inward-directed and global citizenship more outward-directed. 
However, examining practice informed by research identifies further complexity. 


Three Orientations Toward the Goals of Citizenship Education 


n our empirical research in the Netherlands among teachers, students, and parents, we found 
three orientations to citizenship that give special attention to moral values. In several research 
projects (with both quantitative and qualitative instruments), we asked teachers, students, 
and parents about which educational goals relating to moral values and society they found 
important. Most of the research was in secondary schools, but also some in primary schools. We 
conducted a representative survey among Dutch secondary school teachers. We also performed 
case studies in schools using surveys, interviews, panels, and observations to collect data from 
teachers, students, and parents. Statistical analyses of the survey among teachers showed three 
clusters of teachers supporting specific but different educational goals: discipline, autonomy, 
and social involvement (Leenders et al. 2008a; 2008b; 2012). More conceptual explorations of 
these clusters are found in Veugelers (2007; 2017b). 


1) Discipline and Norms: teachers in this cluster emphasize goals promoted by the educational 
movement called “character education” (Lickona 1991). This approach to moral education 
promotes students following norms of good behaviour. Educators teach students how they 
should behave. 


(2) Autonomy: teachers in this cluster refer to personal empowerment and students formulating 
their own opinions. These goals are central in the moral development tradition of Kohlberg 
(Power et al. 1989) but also in the structural sociology of Giddens (1990), which emphasizes 
"agency." Autonomy can be defined as making free choices that give meaning to life. 


(3) Social Involvement: teachers in this cluster support a broad spectrum of social goals, from 
empathy as social psychologists define it, to a social justice-based solidarity and commitment 
to combat inequality in society. Looking at this in a broader context, different orientations 
exist within social involvement: the justice approach of Rawls (1971) and Kohlberg, the 
concept of care of Noddings (2002), and the sense of empowerment expressed by the 
Brazilian pedagogue Freire (1985). Social involvement can vary greatly in its political 
orientation and in the articulation of the moral values involved. 


Note that these results are similar to the three teacher profiles based on civic education aims that 
were identified by Reichert and Torney-Purta (2019) using ICCS 2009 data from 12 countries, 
not including the Netherlands. 
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Three Profiles in the Goals and Aims of Nationally Based Citizenship 
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(3) The third type is critical-democratic citizenship. There is a belief that social involvement 
and autonomy are very important and discipline less important. The focus is on critical 
analysis of issues and engagement with the common good. This can lead to encouraging 


action against inequality, for example. This perspective tries to balance the moral values 
of autonomy with social concern. In education there is a focus on appreciating diversity 
and living in harmony but also on active student participation in dialogues with those who 


have different backgrounds or opinions. Cooperative and inquiry-oriented learning is often 
an approach. Attention is given to critical reflection on social values. 


We have defined the types of citizenship and correspo 


nding practical classroom interpretation 
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er orientations like autonomy and social 


involvement. This typology demonstrates that different orientations to the moral and political 


nature of citizenship and citizenship education exist. O 


ne does not need to label one as superior 


to others, they each are linked to broader philosophical and political ideas. As important, it also 


shows that school leaders and teachers make choice 


s in their educational goals and in their 


educational practice. Different aspects of citizenship will be important in specific countries and 
under specific circumstances. These are among the reasons for national differences in the civic 


education studies’ results. Our empirical studies in the 


etherlands show that many teachers like 


critical-democratic citizenship education, but it is less 


frequently seen in practice than a more 


adaptive citizenship. Individualized citizenship education is not very popular among teachers 


but it is strongly embedded in schools through systems of individual assessment, comparison, 


selection, and tracking of students. The educational guid 


ance given by teachers is strongly directed 


at the school career and well-being of the individual student. This school practice reinforces an 


individualized citizenship (Veugelers 20175). 


Three Profiles in the Goals and Aims of Global Citizenship 


The concept of citizenship has been broadened from 


the national to the global level in recent 


decades. The process of globalization is influencing civic and citizenship education. Most 


definitions of globalization emphasize the links between different parts of the world. The 
content of globalization is ideologically charged and differs in different world regions and within 


countries (Roderik 2011). In parallel with national cit 


tizenship we also studied how teachers 
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and researchers are defining and using the concept of global citizenship. We explored different 
meanings and practices that instantiate concepts of global citizenship in education (Veugelers 
2011b). We analyzed literature and conducted interviews with secondary school teachers about 
their concepts and practices. Based on the literature review and the interviews we identified 
three types of global citizenship. These are still under development without empirical support 
to the extent of that in previous section. 


1) An open global citizenship education focuses on knowledge about and openness to other 
cultures. Many people refer to an open global citizenship as a neo-liberal mix of cultural 
diversity and market economy. It is a quite popular notion, however it is difficult to find 
scholars who clearly express such a liberal view on global citizenship. 


(2) A moral global citizenship education has three pillars: 
a) Creating possibilities for each human being to develop his or her capabilities (Nussbaum 
1997). 


b) Aconcern for the planet and all its inhabitants. This includes a focus on environmental 
sustainability; it challenges each human being to take moral responsibility and to 
contribute through concrete actions (Gaudelli 2016). 


c) Open communication in which everyone can participate. This is often called 
“cosmopolitanism” and refers to the Greek idea of the polis (Appiah 2005; Hansen 
2011). This dimension of global citizenship is especially linked with attention to human 
rights as a moral force. 


(3) A social-political global citizenship addresses unequal power relations and is devoted to 
social justice and a corresponding political change. Proponents of this view criticize mora 
global citizenship as not taking political power relations into account. Social-political globa 
citizenship is committed to combatting inequality and creating a more just society. This 
position can be found in the work of critical pedagogy, in particular Paulo Freire (1985), in 
political philosophy (Mouffe 2005; 2017), and in post-colonialist thinking (Andreotti 2011). 


There is a sense of hierarchy in this typology. Moral global citizenship adds a concern for each 
human being, humanity, and the planet to open global citizenship. The social-political globa 
citizenship approach not only challenges individuals to become moral as global citizens, but also 
pushes for political change, empowerment, equality, and social justice to realize such a mora 
world for all. 


As in the typology for national citizenship, these different types of global citizenship are linked 
with educational practices. In our research, many Dutch teachers said that they focus on a moral 
global citizenship. They encourage students to engage in dialogues, to support human rights, and 
to commit to building a better world. However, teachers try to avoid overt politics. Addressing 
injustice and transformation of power relations is not their approach to citizenship education. 
Their argument is that they should be neutral. They dont really address social problems or put 
these in a political framework (Veugelers 201 1b). 


any recent publications focus on what we have called a “moral global citizenship.” For example, 
Hansen (2011) argues for a cosmopolitan education that includes a space in which each 
person has the opportunity to become part of a dialogue. A typical example of a moral global 
citizenship education perspective is the book by Gaudelli, Global Citizenship Education: Everyday 
transcendence. He acknowledges that there are concerns about the rapid integration of the world 
(hyper-globalization), particularly regarding economic and environmental consequences. He also 
formulates the following as a long-term educational goal: “An aspirational sense of being human 
as a universal condition coupled with openness to the plurality of people and their environs” 
(Gaudelli 2016, p. 6). 
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A Moral Education Perspective on International Civic and Citizenship 
Education Studies 
Based on this overview of different articulations of citizenship and global citizenship education 


we now analyze what a moral perspective on citizenship studies such as ICCS reveals and 
address four issues: 
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conceptual framework and were operationalized in the measurement instruments. A recent 
review by Knowles et al. (2018) examined 100 articles reporting secondary analysis of | 
civic education data published since 2000 and 


found that a very large majority focused on the 
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attitudinal and participatory data (not the civic knowledge scores). In particular, many authors 
from Belgium (Flemish), Italy, and Sweden were represented. The potential value of the findings 
of these studies for illuminating moral education issues should be explored as it is often implicit 
rather than explicit. 


2. Subjectification as an issue 


Dialogue plays a vital role in a social-constructivist perspective on learning as students explore 
meaning in the social world and develop attitudes and moral values (Veugelers 2019a). Biesta 
2011) speaks of subjectification, which is not sufficiently captured by the term socialization. 
What is missing is the personal articulation: the individual student interprets concepts in a 
subjective fashion based on their own experience and through dialogue with others. Paying 
attention to subjectification in education is according to Joris and Agirdag (2019) at odds with 
a strong focus on goals and prescribed learning outcomes. They criticize the ICCS research 
from this perspective. Joris and Agirdag (2019, p. 287) conclude: “Our analysis shows that the 
qualification and socialization functions are dominantly validated in all aspects of the study, whilst 
there is only marginal attention to subjectification. This implies that ICCS misses an important 
potential to document and/or promote pupils becoming autonomous and critical democratic 
citizens, whilst this is often considered a central aim of citizenship education by policymakers, 
practitioners and teachers.” 


The arguments made by Joris and Agirdag make us aware of the relevance of individuals’ 
construction of meaning. This suggests conducting research to show how students develop 
personal narratives relating themselves to citizenship (see, for example, De Groot et al. 2014). 
We recognize that quantitative research methods that are dominant in the IEA civic education 
studies cannot catch the concrete personal meanings of concepts and actions for each student. 
The IEA civic education studies’ leaders are aware of this and have encouraged follow-up research 
projects incorporating more qualitative as well as quantitative approaches. The country chapters 
in this book present some of those studies. 


3. The meaning of democratic citizenship 


All nations recognize citizenship qualifications and have a more or less explicit citizenship policy 
related to a more or less formal curriculum of citizenship education. Nations have political 

gimes, ranging from authoritarian to democratic, and within democracy there are different 
articulations. So all nations have an idea of citizenship and have a practice of citizenship education. 

om an academic perspective it would be interesting to be able to inquire in all nations about 
different concepts of political regimes and citizenship in order to have a broad perspective for 
understanding different kinds of citizenship. Now ICCS focuses on aspects of democracy like 
elections, freedom of speech, and political representation. It is understandable that only regimes 
that have the kind of democracy based on these principles join the ICCS studies. Of course, it 
would be very difficult to do research on citizenship in non-democratic countries. In reality ICCS 
is a study not of citizenship but of democratic citizenship. 


n the Latin America study that is part of ICCS there are some questions about dictatorship. 
When asked if people would like to have a dictatorship most people say no, however when asked 
about a dictatorship that has brought economic prosperity, many people have fewer problems 
with it. It would be interesting to include questions that challenge the notion of democracy in 
the general ICCS-questionnaire. It might be helpful to enhance the set of questions about what 
is good and bad for democracy (currently in the general ICCS questionnaires) in order to focus 
on a wider range of threats to democracy. Presently included are questions about whether one 
company owning all the newspapers is good or bad for democracy and a similar question about 
leaders appointing members of their own families to government positions. It is important to 
realize that democracy is a moral concept. It includes ideas about the way to organize society. 
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One of the good things about democracy is that it supports research about the political system 
and citizens’ opinions. Joining ICCS studies can be thought of as a kind of support for democratic 
openness. This point is also made in some country chapters in this volume. 


4. Social and cultural dimensions of citizenship 


The beginning of this chapter spoke about deepening the concept of citizenship. Not only is the 
political domain relevant, but also the social and cultural. It is about how people live together. 
It focuses at the same time on dealing with social and cultural differences and on what bonds 
people: on what keeps society together, on common moral values, and on norms and traditions. 
This bonding is in fact specific for each country. Each country has its own history and culture, 
and its own specific articulations of moral values. Countries can differ in how much they stress 
their own cultural tradition, expect individuals today to adapt to an “older” national culture and 
emphasize the homogeneity of it. 


Countries can also show how their histories adapt to a mixture of traditions and some have 
a fluid social-cultural citizenship that is open to new influences. Inquiring about specific 
national articulations of citizenship is difficult in a comparative study. A study like ICCS looks 
for commonalities and compares countries on these specific variables. Countries also have 
opportunities to interpret and, in some cases, to add material in national questionnaires or other 
studies (as some country chapters in this volume discuss). This is not in any way an argument 
against comparative studies like ICCS but a suggestion to countries to give attention to the 
national context and to topics such as the moral education dimension when interpreting findings 
about commonalities and differences. 


The Moral Dimension in the Conceptual Framework of ICCS 


We now will analyze the assessment framework of the ICCS 2016 study referring to specific 
pages in Schulz et al. (2016). The authors speak of recent developments and persisting 
challenges (p. 3) and of broadening the scope of ICCS (p. 5). Recent developments mentioned 
are the financial crisis and environment; persisting challenges are the concepts of democracy 
and globalization. Broadening the scope of ICCS 2016 meant inclusion of three areas (p. 5): 
environmental sustainability, social interaction in school, and the use of new social media for civic 
engagement. We earlier mentioned the deepening of the concept of citizenship at the social and 
cultural level. Here even the environmental level is included. The second area, social interaction 
at school, can be seen as citizenship lived in the daily life of youngsters. School is a place where 
children can practice living together, hopefully in a democratic way. The third area, social media, 
extends political dialogues outside the traditional institutions and formal political dialogues, and 
includes informal ways of participation as part of civic life. This can be digital. These interactions 
between citizens are more informal and more related to students’ daily lives. Other areas were 
identified that could be explored for future assessments including economic awareness and the 
role of morality in civic and citizenship education (p.6): “Concepts of morality and character are 
often involved in relation to outcomes of civic and citizenship education programmes ... many 
countries have moral education programmes.” 


There is some coverage of the moral perspective in the research questions for ICCS 2016 (pp. 
7-8). The first research question is about educational programs; the second about outcomes of 
civic knowledge; the third is about engagement in society; the fourth about beliefs concerning 
civic issues such as democracy, citizenship, and society and about sense of identity; and, the fifth 
is about the organization of the school. The moral is embedded in research question four about 
students’ beliefs and attitudes and to some extent in all the others: in particular the engagement 
in society (three) and the interactions in school (five). 
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Chapter 2 of the assessment framework focuses on the civic and citizenship framework. Four 
content areas are distinguished: civic society and systems; civic principles; civic participation; 
and, civic identities (p.12). The student questionnaire includes affective-behavioural variables 
that reflect attitudes and engagement. The content domain of civic principles has the most 
explicit moral content. It consists of four sub-domains: equity, freedom, sense of community, 
and rule of law. In particular, the first three are moral values that are considered as important 
values in a democratic society. The fourth, rule of law, also includes relevant moral dimensions. 


Conclusions 


We can conclude that moral values play an important role in ICCS. They include different 
orientations of citizenship that were mentioned earlier: adaptive, individualized, and critical- 
democratic approaches. They are incorporated in concepts like justice, democracy, and freedom. 
Citizenship in a global and sustainable context stresses moral dimensions even more. 


Amoral values perspective makes clear that besides knowledge and skills, attitudes and concrete 
behaviour are important and that they express moral values. Moral values have always been 
embedded in ICCS, but during recent years they have been getting more explicit attention. This 
reflects developments in many countries that show that societies are searching for meaning and 
direction in terms of moral values. Should they return to a more adaptive orientation, celebrate 

n 

h 


an individual orientation, or take up a democratic orientation to social justice? The questio 
is whether an appropriate balance between these three orientations can be found along wit 
appropriate linkage between moral and political perspectives (Veugelers 2019a; 2019b). 


In conclusion, we present an overarching definition that includes central concepts and attempts 
asynthesis of the moral and civic dimensions of the IEA’s civic education studies. This definition 
defines the domain within a democratic framework but gives people the chance to make their 
own articulation. 


Education for citizenship is about acquiring the abilities and attitudes necessary to participate in 
political and civic life (on local, national, and global levels); about relating to others, in particular 
people with different social, cultural, and ethnic backgrounds; and about concern for the 
sustainability of humanity, of the planet, and of democracy. 


References 


Andreotti, V. (2011). The political economy of global citizenship. Globalisation, Societies and Education, 
9(3-4), 307-310. 


Appiah, K. (2005). The ethics of identity. Princeton, NJ: Princeton University Press. 

Banks, J. (2004). Diversity and citizenship education: global perspectives. San Francisco, CA: Jossey-Bass. 
Banks, J. (Ed.). (2017). Citizenship education and global migration. Washington, DC: AERA. 

Biesta, G. (2011). Learning democracy in school and society. Rotterdam, the Netherlands: Sense Publishers. 
Bourdieu, P. (1984). Distinction. London, United Kingdom: Routledge. 


Crick, B. (1999). The presuppositions of citizenship education. Journal of Philosophy of Education, 33(3), 
337-352. 


De Groot, l., Goodson, l., & Veugelers, W. (2014). Dutch students’ democratic narratives. Cambridge 
Journal of Education, 44(2), 271-292. 


Durkheim, E. (1971[1923]). Moral education. New York, NY: Free Press. 
Freire, P. (1985). The politics of education: Culture, power and liberation. South Hadley, MA: Bergin & Garvey. 


Garcia, B., Sandoval, A., Trevino, E., Diazgranados, S., & Perez, M. (Eds.). (2017). Civics and citizenship: 
theoretical models and experiences in Latin America. Rotterdam, the Netherlands: Sense Publishers. 


Gaudelli, W. (2016). Global citizenship education: everyday transcendence. New York, NY: Routledge. 
Giddens, A. (1990). The consequences of modernity. Cambridge, United Kingdom: Polity. 


300 INFLUENCES OF THE IEA CIVIC AND CITIZENSHIP EDUCATION STUDIES 


Giroux, H. (1989). Schooling for democracy. London, United Kingdom: Routledge. 


Goren, H. & Yemini, M. (2017). Global citizenship redefined: a systematic review of empirical studies on 
global citizenship education. International Journal of Educational Research, 82, 170-183. 


ansen, D. (2011). The teacher and the world. New York, NY: Routledge. 

aste, H. (2004). Constructing the citizen. Political Psychology, 25 (3), 413-440. 

ess, D. (2009). Controversy in the classroom. New York, NY: Routledge. 

sin, E., & Turner, B. (Eds). (2002). Handbook of citizenship studies. London, United Kingdom: Sage. 


Joris, M., & Agirdag, O. (2019). In search of good citizenship: a normative analysis of the International 
Civic and Citizenship Education Study (ICCS). European Journal of Education, 54(2), 287-298. 


ennedy, K., Lee, W. O., & Grossman, D. L. (Eds.). (2018). Citizenship pedagogies in Asia and the Pacific. 
Dordrecht, the Netherlands: Springer. 


err, D. (1999). Citizenship education in the curriculum: an international review. The School Field, 3-4, 5-31. 


nowles, R., Torney-Purta, J., & Barber, C. (2018). Enhancing citizenship learning with international 
comparative research: Analyses of IEA civic education datasets. Citizenship Teaching and Learning, 13, 7-30. 


Leenders, H., Veugelers, W., & De Kat, E. (2008a). Teachers’ views on citizenship in secondary education 
in the Netherlands. Cambridge Journal of Education, 38(2), 155-170. 

Leenders, H., Veugelers, W., & De Kat, E. (2008b). Moral education and citizenship education at pre- 
university schools. In F. Oser, & W. Veugelers (Eds.), Getting involved: Global citizenship development and 
sources of moral values (pp. 57-74). Rotterdam, the Netherlands: SensePublishers. 


Leenders, H., Veugelers, W., & De Kat, E. (2012). Moral development and citizenship education in 
vocational schools. Education Research International, 2012(2). https://doi.org/10.1155/2012/901513 


Lickona, T. (1991). Educating for character. New York, NY: Random House. 
arshall, T.H. (1964). Class, citizenship and social development. Chicago, IL: University of Chicago Press. 


cLaughlin, T. (1992). Citizenship, diversity and education: a philosophical perspective. Journal of Moral 
Education, 21(3), 235-250. 


ouffe, C. (2005). On the political. London, United Kingdom: Routledge. 
ouffe, C. (2017). For a left populism. London, United Kingdom: Verso. 


oddings, N. (2002). Educating moral people. New York, NY: Teachers College Press. 


ussbaum, M. (1997). Cultivating humanity. Cambridge, MA: Harvard University Press. 

Oser, F., & Veugelers, W. (Eds). (2008). Getting involved. Global citizenship development and sources of moral 
values. Rotterdam, the Netherlands: Sense Publishers. 

Osler, A., & Starkey, H. (2010). Teachers and human rights education. London, United Kingdom: IOE press. 
Oxley, L., & Morris, P. (2013). Global citizenship: a typology for distinguishing its multiple conceptions. 
British Journal of Educational Studies, 3, 301-325. 

Parker, W. (2003). Teaching democracy. New York, NY: Teachers College Press. 

Power, F. C., Higgins, A., & Kohlberg, L. (1989). Lawrence Kohlberg's approach to moral education. New 
York, NY: Columbia University Press. 

Rawls, J. (1971). A theory of justice. Cambridge, MA: Harvard University Press. 

Reichert, F., & Torney-Purta, J. (2019). A cross-national comparison of teachers' beliefs about the aims of 
civic education in 12 countries: A person-centered analysis. Teaching and Teacher Education, 77, 112-125. 
Roderik, D. (2011). The globalization paradox. New York, NY: Norton & Company. 

Sim, J. (2011). Social studies and citizenship for participation in Singapore: How one state seeks to 
influence its citizens. Oxford Review of Education, 37(6), 743-761. 

Schulz, W., Ainley, J., Fraillon, J., Kerr, D., & Losito, B. (2010). ICCS 2009 international report. Amsterdam, 
the Netherlands: International Association for the Evaluation of Educational Achievement (IEA). 

Schulz, W., Ainley, J., Fraillon, J., Losito, B., & Agrusti, G. (2016). International Civic and Citizenship Education 
Study 2016. Assessment framework. Cham, Switzerland: Springer. 

Schulz, W., Ainley, J., Fraillon, J., Losito, B., Agrusti, G., & Friedman, T. (2018). Becoming citizens in a changing 
world. IEA International Civic and Citizenship Education Study 2016 international report. Cham, Switzerland: 
Springer. https://doi.org/10.1007/978-3-319-73963-2 


A MORAL PERSPECTIVE ON CITIZENSHIP EDUCATION 301 


Torney-Purta, J. (2002). Patterns in the civic knowledge, engagement, and attitudes of European 
Adolescents. The IEA Civic Education Study. European Journal of Education, 37(2), 129-141. 


Torney, J., Oppenheim, A., & Farnen, R. (1975). Civic education in ten countries: An empirical study. Stockholm, 
Sweden: Almqvist and Wiksell. 


orney-Purta, J., Lehmann, R., Oswald, H., & Schulz, W. (2001). Citizenship and education in twenty-eight 
countries. Amsterdam, the Netherlands: International Association for the Evaluation of Educational 
Achievement (IEA). 

To 


res, C.A. (2017). Theoretical and empirical foundations of critical global citizenship education. New York, 
NY: Routledge. 


Veugelers, W. (2007). Creating critical-democratic citizenship education: Empowering humanity and 
democracy in Dutch education. Compare, 37(1), 105-119. 

Veugelers, W. (2011a). Theory and practice of citizenship education: the case of policy, science and 
education in the Netherlands. Revista de Educacion, 209-224. 

Veugelers, W. (2011b). The moral and the political in global citizenship education: Appreciating differences 
in education. Globalisation, Societies and Education, 9(3-4), 473-485. 

Veugelers, W. (2017a). The moral in Paulo Freire's educational work. Journal of Moral Education, 46, 
412-421. 


Veugelers, W. (2017b). Education for critical-democratic citizenship: Autonomy and social justice in a 
multicultural society. In N. Aloni, & L. Weinrob (Eds.), Beyond bystanders: Educational leadership for a humane 
culture in a globalizing reality (pp. 47-59). Rotterdam, the Netherlands: Sense Publishers. 


Veugelers, W. (2019a). Learning and teaching in critical-democratic education. Utrecht, the Netherlands: 
University of Humanistic Studies. 


Veugelers, W. (Ed.). (2019b). Education for democratic intercultural citizenship. Leiden, the Netherlands: 
Brill/Sense. 


Veugelers, W., De Groot, l., & Stolk, V. (2017). Research for cult committee - Teaching common values in 
Europe. Brussels, Belgium: European Parliament, Policy Department for Structural and Cohesion Policy. 


Westheimer, J., & Kahne, J. (2004). What kind of citizen? The politics of educating for democracy. American 
Educational Research Journal, 41(2), 237-269. 


Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International 
License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution 
and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a 
link to the Creative Commons license and indicate if changes were made. 

The images or other third party material in this chapter are included in the chapter’s Creative Commons license, unless indicated 
otherwise in a credit line to the material. If material is not included in the chapter’s Creative Commons license and your intended use 
is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright 
holder. 


